State Test Score Trends Through 2008-09, Port 2: 

Slow and Uneven Progress 
in Narrowing Gaps 



(center on 
education) 



c 



POLICY 





Credits and Acknowledgments 

This report was written by Nancy Kober, Naomi Chudowsky, and Victor Chudowsky, CEP consultants. 
Sunny Becker, Hilary Campbell, Emily Dickinson, Rebecca Dvorak, and Monica Gribben from the 
Human Resources Research Organization (HumRRO) provided support in data collection and analysis. 
Diane Stark Rentner, CEP’s director of national programs, oversaw the study project for CEP, commu- 
nicated with the expert panel, and provided advice and assistance for all aspects of the study. CEP research 
associate Jennifer McMurrer and CEP interns Malini Roy, Rebecca Johnson and Alexandra Usher assisted 
with data analysis. Jack Jennings, CEP’s president and CEO, provided advice and assistance. 

We would like to thank our panel of expert advisors — Laura Hamilton, Eric Hanushek, Frederick 
Hess, Robert Linn, and W. James Popham — for their invaluable advice. Additionally, we are grateful to 
the chief state school officers and state assessment personnel for their cooperation in providing infor- 
mation on state testing programs and student achievement data. 

Based in Washington, D.C., and founded in January 1995 by Jack Jennings, the Center on 
Education Policy is a national independent advocate for public education and for more effective 
public schools. The Center works to help Americans better understand the role of public education 
in a democracy and the need to improve the academic quality of public schools. We do not repre- 
sent any special interests. Instead, we help citizens make sense of the conflicting opinions and per- 
ceptions about public education and create the conditions that will lead to better public schools. 

The Center on Education Policy receives nearly all of its funding from charitable foundations. We are grate- 
ful to the Carnegie Corporation, the Smith Richardson Foundation, and the Spencer Foundation for 
their support of the student achievement study. The George Gund Foundation and the Phi Delta Kappa 
International Foundation also provide the Center with general support funding that assisted us in this 
endeavor. The statements made and views expressed are solely the responsibility of the Center. 



© Center on Education Policy December 2010 



State Test Score Trends Through 2008-09, Port 2: 

Slow and Uneven Progress 
in Narrowing Gaps 




( CENTER ON 



EDUCATION 



(policy 



D 



Center on Education Policy 

December 2010 



Center on Education Policy 



Table of Contents 



Executive Summary 1 

Chapter 1: Findings Across Student Groups 4 

Chapter 2: African American Students 17 

Chapter 3: Asian American Students 20 

Chapter 4: Latino Students 23 

Chapter 5: Native American Students 26 

Chapter 6: White Students 29 

Chapter 7: Low-Income Students 30 

Chapter 8: Male and Female Students 33 

Chapter 9: Comparison of Trends on State Tests and NAEP .... 36 
Chapter 10: Study Methods 45 



Executive Summary 



After eight years of implementing the federal No Child Left Behind Act (NCLB) 
and other school reforms, how much progress have states, school districts, and 
schools made in raising achievement for students from all backgrounds and clos- 
ing achievement gaps based on race, ethnicity, income, and gender? 



Many states had gaps in percentages proficient of 25 points or more between stu- 
dents from low-income families and those who were not low-income. In read- 
ing, girls had higher percentages proficient than boys in every state and D.C.; 
this gender gap sometimes totaled 1 0 percentage points or more. 



To help answer this question, the Center on Education Policy (CEP) analyzed 
trends in reading and mathematics performance and achievement gaps for sev- 
eral groups of students: African American, Asian, Latino, Native American, and 
white students, as well as low-income, male, and female students. We looked at 
trends on state tests from 2002 (or a more recent year in some states) through 
2009 at grades 4, 8, and the high school grade tested for NCLB. We also com- 
pared the direction of trends between 2005 and 2009 on state tests and the fed- 
erally sponsored National Assessment of Educational Progress (NAEP). 

All 50 states and the District of Columbia participated in this study, which marks 
the fourth year of CEP’s research on student achievement. Not all states had the 
data needed for every analysis, however. States were considered to have suffi- 
cient data for an analysis if they had three or more years of comparable test data 
through 2009 and if the number of students in a particular subgroup was large 
enough to yield reliable trends. 



Main conclusions 

Four main conclusions emerged from this study. 



• Every major student group has made gains since 2002 on state reading 
and math tests. But even when achievement has increased for all groups, 
gaps have not always narrowed. 

African American, Asian, Latino, Native American, and white students, as well 
as low-income students, boys, and girls, made gains in reading and math in two- 
thirds or more of the states with sufficient data. For each subgroup, states with 
gains on state tests outnumbered states with declines or flat trends in both read- 
ing and math and at grades 4, 8, and high school. This pattern was also evident 
on both indicators of achievement used for this study — the percentages of stu- 
dents scoring proficient on state tests and average (mean) test scores. 



Within the same state, trends on NAEP corroborated the rising trends on state 
tests to a moderate degree. In math, a majority of the states with sufficient data 
that made gains for a particular student group on their state test also made gains 
on NAEP, except for Asian students in 4 th grade math. In reading, a majority of 
the states with sufficient data showed gains on both state tests and NAEP for all 
subgroups except 4 th grade boys. But NAEP and state results contradicted each 
other more often in reading than in math, and in some cases reading achieve- 
ment declined on both assessments. 




• Achievement gaps are large and persistent. 

In many states, the percentage of African American students scoring proficient 
on state tests was 20 to 30 points lower in 2009 than the percentage proficient 
for white students. Gaps in percentages proficient between Native American 
and white students were similarly wide. Gaps between Latino and white stu- 
dents often amounted to 1 5 to 20 percentage points. 



Rising achievement for all groups is no guarantee that achievement gaps will 
shrink. When gaps widened, it was often because both subgroups made gains, 
but the higher- achieving group improved more rapidly than the lower-achiev- 
ing one. For gaps to narrow, the lower- achieving group must improve at a greater 
rate than the higher-achieving one. 
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• For most student groups, gaps on state tests have often narrowed since 
2002. Gap trends vary, however, based on the student group and indicator 
of achievement examined. 

Latino-white gaps and African American-white gaps in percentages proficient on 
state tests have narrowed more often than gaps for Native American students, low- 
income students and boys in reading. For all of these groups, however, gaps in 
some grades and subjects have widened or stayed the same in a notable number of 
states. Usually when gaps narrowed, both subgroups improved, but the lower-per- 
forming group improved at a greater rate than the higher-performing one. 

Average test scores, which are generally considered a better indicator of changes 
in gaps than percentages proficient for reasons discussed in chapter 1, give a 
7^) somewhat less positive picture of gaps narrowing. Across both reading and math 
and all three grade levels, the gap between low-income students and more advan- 
taged students, for example, narrowed in 57% of the instances analyzed using 
average scores, compared with 72% of instances using percentages proficient. 
(An “instance” refers to a trend in a single state for one gap, grade level, and sub- 
ject, such as the change in the gap between low-income and non-low-income 
students in Kentucky in grade 8 math.) 

In addition, trends on state tests and NAEP within the same state show limited 
agreement about whether achievement gaps have narrowed since 2005 at grades 
4 and 8. For some groups, gaps narrowed on both state tests and NAEP in a 
majority of the states with sufficient data. But there were also many instances of 
gaps narrowing on the state test and widening on NAEP In a limited number 
of instances, a gap widened on NAEP but narrowed on the state test, or widened 
on both assessments. 

• Although gaps have narrowed more rapidly for some groups than for 
others, at the current rates of progress it would take many years to close 
most gaps. 

In general, Latino-white gaps in percentages proficient have narrowed at a greater 
rate than gaps for other groups. For some grades and subjects, African American- 
white gaps have also narrowed at a relatively fester rate than most other gaps. In high 
school math, for example, the gap in percentages proficient between Latino and 
white students narrowed at a median rate of 1.2 percentage point per year across all 
the states with sufficient data. (The median is the midpoint; by definition, half of 



the states with sufficient data will have annual rates of change in a gap above the 
median, and half will have rates below it.) If this gap continued to narrow at the 
same annual rate and if other critical factors remained the same, then theoretically 
a gap of 1 5 points would close in 1 2. 5 years. For reasons discussed in chapter 1 , how- 
ever, it is unlikely that gaps would continue to narrow at a steady rate. 

Other gaps, such as Native American-white gaps, are narrowing at median rates 
of less than 1 percentage point per year. These gaps would take much longer to 
close if the current pace continued. 

Data from individual states also suggest it would take one or more decades to 
close most gaps at the current average rates of progress. In Florida, a state with a 
typical-size gap, the African American-white gap in percentages proficient has 
narrowed at an average rate of 0.9 percentage point per year since 2002. In 2009, 
this gap remained at 25 percentage points. If the gap continued to narrow at the 
same rate and if other key factors remained unchanged, then theoretically it would 
take 28 years to close this gap. In Pennsylvania, the gap between Latino and white 
students has narrowed at an average rate of 1.5 percentage point per year since 
2002. In 2009, this gap stood at 25 percentage points, a typical-size gap for these 
subgroups. At the current rate of progress, it would take 17 years to close this 
gap. As illustrated by examples from other states in chapter 1 , the pace of change 
also varies considerably even among states with gaps of similar size. 

In conclusion, we looked at an array of evidence from state tests and NAEP, 
including average test scores on both assessments, the percentages of students 
scoring proficient on state tests, and the percentages scoring at the basic level on 
NAEP. Taken together, the evidence indicates that although some headway has 
been made in narrowing achievement gaps, progress is inconsistent, and much 
work remains. 



Organization of this report 



The full report of this study is available on CEP’s Web site at www.cep-dc.org. 
The report includes the following chapters: 



• Chapter 

• Chapter 

• Chapter 

• Chapter 

• Chapter 

• Chapter 

• Chapter 

• Chapter 

• Chapter 

• Chapter 



1 — Findings Across Student Groups 

2 — African American Students 

3 — Asian Students 

4 — Latino Students 

5 — Native American Students 

6 — White Students 

7 — Low-Income Students 

8 — Male and Female Students 

9 — Comparison of Trends on State Tests and NAEP 

10 — Study Methods 



State- by-state information is available on the Web 
in an appendix and individual state profiles. 

Readers interested in particular states are encouraged to view and download two 
additional resources available at www.cep-dc.org: 

• An appendix with state-by-state tables showing the 2009 percentages profi- 
cient, mean test scores, and achievement gaps in reading and math for all 
major subgroups in the states with sufficient data 

• Individual state profiles, one for each of the 50 states and D.C., containing 
a wealth of state-specific data on the states testing program, trends in sub- 
group performance as well as achievement gaps for all the years with com- 
parable data, and numbers of test-takers. 
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Chapter 1 : Findings Across Student Groups 



Achievement gaps on state tests between lower- 
and higher-performinggroups are often large. 



between Native American and white students amounted to 20 or 30 percentage 
points. The Latino-white gap in percentages proficient often totaled 1 5 to 20 
percentage points. 




This chapter presents cross-cutting findings about achievement on state reading 
and math tests for all the major student groups included in this study — African 
American, Asian, Latino, Native American, and white students, as well as low- 
income, male, and female students. 1 The tables in this chapter summarize key 
data across multiple subgroups, unlike the more detailed tables for each specific 
subgroup contained in chapters 2 through 8. 

Our analysis of state test results looked at two indicators of achievement — the 
percentages of students scoring at or above the proficient level, which is the main 
gauge of progress under NCLB; and average, or mean, test scores. These two 
indicators offer different ways of looking at achievement trends. Viewed in tan- 
dem, they can provide a fuller picture of the performance of a group of students. 
Percentages proficient typically show the proportion of students in the aggregate 
that have met or exceeded a fixed benchmark — the cut score for proficient per- 
formance on the state test. Mean scores are independent of cut scores and there- 
fore capture changes across the achievement spectrum, including performance 
well above or well below the proficiency cut score. To provide an additional per- 
spective, the study also examined trends on NAEP, as discussed in chapter 9. 

Among racial/ethnic groups, Asian and white students had the highest test per- 
formance. In reading, the Asian and white subgroups often performed at simi- 
lar levels, but in math, Asian students outperformed white students in most of 
the states with sufficient data. 

Other subgroups typically performed at lower levels. In many states, the gaps in 
percentages proficient between African American and white students and 



Gaps also persisted between students from low-income families and those who 
were not low-income. In many states, gaps in percentages proficient between 
these two groups totaled 25 percentage points or more. In reading, a gender gap 
also exists. In 2009, girls outperformed boys in reading in every state and D.C., 
sometimes by more than 10 percentage points. 

Large gaps between subgroups can also be found in mean test scores. 

For all of the subgroups analyzed, the size of achievement gaps varied consider- 
ably from state to state. In grade 4 reading, for example, the largest Latino-white 
gap in any state was 38 percentage points in 2009, while the smallest gap in any 
state was 5 points. These variations may not be solely, or even mostly, due to dif- 
ferences in instructional quality but may also be attributable to state-by-state 
differences in where the cut score for proficiency is set, how difficult the test is, 
and other factors. The appendix to this report, available at www.cep-dc.org, 
shows the size of the gaps in 2009 for all major subgroups in each state. 

One way to gauge the relative performance of various student groups on a 
broader scale than a single state is to look at a statistic called the median. The 
median is the midpoint; by definition, half of the states with sufficient data have 
percentages proficient above the median, and half have percentages proficient 
below it. For every subgroup, we calculated the 2009 median percentage profi- 
cient across all of the states with sufficient data for that group. The results are 
shown in table 1 (reading) and table 2 (math). 



CEP examined test score trends for English language learners (ELLs) and students with disabilities in two recent reports, which concluded that it is difficult to obtain a clear picture of achievement for these two groups because 
of fuzzy data, evolving state testing policies, fluctuating numbers of test-takers, and language barriers in the case of ELLs. See Center on Education Policy, State Test Score Trends Through 2007-08, Part 4: Has Progress Been Made 
in Raising Achievement for Students with Disabilities? (2009); and State Test Score Trends Through 2007-08, Part 6: Has Progress Been Made in Raising Achievement for English Language Learners? (2010). 



As these tables reveal, performance differs markedly by subgroup. In grade 4 
reading, for example, the median percentage proficient ranged from 58% for 
Native American students to 84% for Asian students. In grade 8 math, the medi- 
ans ranged from 46% for African Americans to 84% for Asians. 

Tables 1 and 2 also indicate how much the percentage proficient for a particu- 
lar group varies by state. In high school math, for example, the percentage of 
African American students scoring proficient ranged from 7% in the lowest state 



to 89% in the highest state, while the Latino percentage proficient ranged from 
9% to 93%. For white students, the range was somewhat narrower but still sub- 
stantial — from 33% in the lowest state to 97% in the highest state. 



Table i. READING: Median, highest, and lowest percentages proficient for subgroups across all states with sufficient state test data, 2009 





African 

American 


Asian 


Latino 


Native 

American 


White 


Low-Income 


Female 


Male 


Grade 4 


Median PP across states 


59% 


84% 


62% 


58% 


83% 


64% 


77% 


71% 


Highest PP in any state 


88% 


95% 


92% 


86% 


96% 


92% 


96% 


94% 


Lowest PP in any state 


28% 


44% 


28% 


36% 


52% 


29% 


51% 


39% 


# of states with data 


41 


36 


43 


19 


50 


46 


51 


51 


Grade 8 


Median PP across states 


54% 


83% 


60% 


59% 


79% 


57% 


77% 


66% 


Highest PP in any state 


91% 


98% 


92% 


94% 


96% 


92% 


97% 


94% 


Lowest PP in any state 


27% 


55% 


34% 


39% 


56% 


33% 


52% 


38% 


# of states with data 


41 


35 


42 


21 


50 


46 


51 


51 


High school 


Median PP across states 


53% 


79% 


62% 


54% 


81% 


60% 


79 % 


71% 


Highest PP in any state 


95% 


99% 


97% 


96% 


98% 


96% 


98% 


97% 


Lowest PP in any state 


18% 


54% 


30% 


37% 


48% 


23% 


38% 


34% 


# of states with data 


37 


32 


38 


19 


47 


43 


48 


48 


Table reads: Across all 41 states with sufficient data, the median percentage of African American students scoring proficient in grade 4 reading was 59%. The highest percentage proficient in any state for the 
African American subgroup was 88%, while the lowest in any state was 28%. 

PP = Percentage proficient 
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Table 2. MATHEMATICS: Median, highest, and lowest percentages proficient for subgroups across all states with sufficient state test data, 2009 





African 

American 


Asian 


Latino 


Native 

American 


White 


Low-Income 


Female 


Male 


Grade 4 


Median PP across states 


58% 


88% 


67% 


62% 


84% 


64% 


75% 


74% 


Highest PP in any state 


90% 


97% 


94% 


87% 


97% 


93% 


96% 


96% 


Lowest PP in any state 


21% 


49% 


25% 


29% 


51% 


28% 


43% 


41% 


# of states with data 


41 


36 


44 


19 


50 


46 


51 


51 


Grade 8 


Median PP across states 


46% 


84% 


58% 


51% 


76% 


51% 


67% 


66% 


Highest PP in any state 


84% 


96% 


87% 


79% 


94% 


86% 


93% 


91% 


Lowest PP in any state 


20% 


38% 


22% 


28% 


45% 


25% 


42% 


36% 


# of states with data 


41 


35 


42 


21 


50 


46 


51 


51 


High school 


Median PP across states 


43% 


81% 


54% 


46% 


69% 


43% 


63% 


61% 


Highest PP in any state 


89% 


98% 


93% 


92% 


97% 


84% 


94% 


93% 


Lowest PP in any state 


7% 


33% 


9% 


18% 


33% 


12% 


25% 


30% 


# of states with data 


37 


32 


39 


19 


47 


42 


48 


48 


Table reads: Across all 41 states with sufficient data, the median percentage of African American students scoring proficient in grade 4 math was 58%. The highest percentage proficient in any state for the African 
American subgroup was 90%, while the lowest in any state was 21%. 

PP = Percentage proficient 





States with gains for subgroups 
on state tests far outnumber 
states with declines. 

African American, Asian, Latino, Native American, 
and white students, as well as low-income students, 
boys, and girls, have made gains since 2002 in two- 
thirds or more of the states with sufficient data. 2 
Tables 3 (reading) and 4 (math) show the percent- 
ages of these states that posted gains, declines, or flat 
trends on state tests for each subgroup at grades 4, 
8, and high school. As the tables illustrate, states 
with gains outnumbered states with declines or flat 
trends for every subgroup, in both subjects and at all 
three grade levels. 

The pattern of states with gains outnumbering 
states with declines was evident in both percentages 
proficient and mean test scores. 

Progress was especially noteworthy for Latino and 
African American students in grade 8 math; all or 
nearly all states made gains for these two groups in 
this grade and subject. 



2 The trend analyses in this report included only those states with three 
or more years of comparable test data through 2009. The starting year 
of the trends varies, however. In states with comparable data going 
back to 2002, the trends begin in 2002. In states that made changes in 
their testing program after 2002, the trends may start in any year from 
2003 to 2007 but end in 2009 in all cases. 



Table 3. READING: Percentage of states with sufficient data showing various trends for 
subgroups on state tests, 2002-2009* 




African 

American 


Asian 


Latino 


Native 

American 


White 


Low- 

Income 


Female 


Male 


Grade 4 PP 


% of states with gain 


88% 


84% 


89% 


81% 


88% 


90% 


84% 


84% 


% of states w/ decline 


12% 


13% 


11% 


19% 


2% 


5% 


12% 


5% 


No change 


0% 


3% 


0% 


0% 


10% 


5% 


5% 


9% 


# of states with data 


34 


31 


37 


16 


42 


42 


43 


43 


Grade 4 MS 


% of states with gain 


79% 


85% 


84% 


67% 


92% 


91% 


89% 


81% 


% of states w/ decline 


10% 


12% 


16% 


20% 


6% 


6% 


8% 


14% 


No change 


10% 


4% 


0% 


13% 


3% 


3% 


3% 


6% 


# of states with data 


29 


26 


31 


15 


36 


34 


36 


36 


Grade 8 PP 


% of states with gain 


94% 


83% 


92% 


89% 


93% 


93% 


93% 


93% 


% of states w/ decline 


6% 


13% 


8% 


11% 


7% 


7% 


7% 


7% 


No change 


0% 


3% 


0% 


0% 


0% 


0% 


0% 


0% 


# of states with data 


34 


30 


36 


18 


42 


42 


43 


43 


Grade 8 MS 


% of states with gain 


90% 


84% 


87% 


82% 


92% 


97% 


89% 


89% 


% of states w/ decline 


7% 


16% 


13% 


12% 


8% 


0% 


8% 


6% 


No change 


3% 


0% 


0% 


6% 


0% 


3% 


3% 


6% 


# of states with data 


29 


25 


30 


17 


36 


34 


36 


36 


High school PP 


% of states with gain 


83% 


82% 


91% 


82% 


92% 


92% 


82% 


84% 


% of states w/ decline 


10% 


14% 


6% 


12% 


8% 


8% 


18% 


16% 


No change 


7% 


4% 


3% 


6% 


0% 


0% 


0% 


0% 


# of states with data 


30 


28 


33 


17 


37 


38 


38 


38 


High school MS 


% of states with gain 


88% 


87% 


85% 


86% 


77% 


84% 


77% 


81% 


% of states w/ decline 


12% 


13% 


11% 


14% 


16% 


13% 


16% 


10% 


No change 


0% 


0% 


4% 


0% 


6% 


3% 


6% 


10% 


# of states with data 


25 


23 


27 


14 


31 


31 


31 


31 


Table reads: On state grade 4 reading tests, 88% of the 34 states with sufficient data showed gains since 2002 in the percentage of 
African American students scoring proficient, and 12% showed declines. Of the 29 states with sufficient mean score data in grade 4 
reading, 79% showed gains in average scores for African American students, 10% showed declines, and 10% had no net change. 


*The years covered by these trends vary among states. Trends in some states begin later than 2002, although every state included in the 
table has at least three years of comparable test data ending in 2009. 


PP = Percentage proficient; MS = mean score 
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Table 4. MATHEMATICS: Percentage of states with sufficient data showing various trends for 
subgroups on state tests, 2002-2009* 




African 

American 


Asian 


Latino 


Native 

American 


White 


Low- 

Income 


Female 


Male 


Grade 4 PP 


% of states with gain 


94% 


87% 


92% 


82% 


98% 


91% 


98% 


93% 


% of states w / decline 


6% 


7% 


3% 


12% 


2% 


7% 


0% 


7% 


No change 


0% 


7% 


5% 


6% 


0% 


2% 


2% 


0% 


# of states with data 


33 


30 


37 


17 


42 


43 


43 


43 


Grade 4 MS 


% of states with gain 


86% 


92% 


90% 


81% 


97% 


89% 


92% 


92% 


% of states w/ decline 


14% 


8% 


10% 


19% 


3% 


9% 


6% 


6% 


No change 


0% 


0% 


0% 


0% 


0% 


3% 


3% 


3% 


# of states with data 


28 


25 


31 


16 


36 


35 


36 


36 


Grade 8 PP 


% of states with gain 


97% 


93% 


100% 


95% 


98% 


98% 


98% 


98% 


% of states w/ decline 


3% 


3% 


0% 


5% 


2% 


2% 


2% 


2% 


No change 


0% 


3% 


0% 


0% 


0% 


0% 


0% 


0% 


# of states with data 


33 


29 


35 


19 


42 


43 


43 


43 


Grade 8 MS 


% of states with gain 


100% 


100% 


100% 


89% 


94% 


94% 


97% 


91% 


% of states w / decline 


0% 


0% 


0% 


11% 


3% 


3% 


3% 


3% 


No change 


0% 


0% 


0% 


0% 


3% 


3% 


0% 


0% 


# of states with data 


28 


24 


29 


18 


36 


35 


36 


36 


High school PP 


% of states with gain 


77% 


83% 


97% 


83% 


77% 


92% 


80% 


80% 


% of states w/ decline 


23% 


14% 


3% 


11% 


18% 


8% 


20% 


18% 


No change 


0% 


3% 


0% 


6% 


5% 


0% 


0% 


3% 


# of states with data 


31 


29 


34 


18 


39 


39 


40 


40 


High school MS 


% of states with gain 


88% 


91% 


93% 


71% 


75% 


84% 


73% 


73% 


% of states w/ decline 


12% 


9% 


7% 


29% 


13% 


13% 


18% 


15% 


No change 


0% 


0% 


0% 


0% 


13% 


3% 


9% 


12% 


# of states with data 


25 


23 


27 


14 


32 


31 


33 


33 


Table reads: On state grade 4 math tests, 94% of the 33 states with sufficient data showed gains since 2002 in the percentage of African 
American students scoring proficient, and 6% showed declines. Of the 28 states with sufficient mean score data in grade 4 reading, 86% 
showed gains in average scores for African American students, and 14% showed declines. 


‘The years covered by these trends vary among states. Trends in some states begin later than 2002, although every state included in the 
table has at least three years of comparable test data ending in 2009. 


PP = Percentage proficient; MS = mean score 
















Student groups have made gains in both average 
test scores and percentages proficient. 



States with gains in average (mean) scores for subgroups outnumbered states 
with declines. This pattern becomes especially apparent if one combines all of 
the trend lines analyzed across both subjects and all three grade levels. (As used 
in this study, a trend line is a record of change in a test result for one subgroup, 
subject, and grade level in a single state. For example, the change from 2002 to 
2009 in the percentage proficient in math for Asian 8 th graders in Colorado 
constitutes one trend line.) 

As displayed in table 5, the proportions of trend lines with gains using mean 
scores were quite similar to the proportions with gains using percentages profi- 
cient. In both cases, at least 80% of the trend lines analyzed — and sometimes 
more than 90% — showed gains. 



Table 5. Percentage of trend lines across two subjects and three grade levels that show gains on state tests for subgroups, 2002-2009* 





African American 


Asian 


Latino 


Native American 


White 


Low-Income 


Female 


Male 


% with gains in MS 


88% 


90% 


90% 


80% 


88% 


90% 


86% 


86% 


% with gains in PP 


89% 


85% 


93% 


86% 


91% 


93% 


89% 


89% 



Table reads: Across both reading and math and grades 4, 8, and high school, 88% of the trend lines analyzed showed gains in average test scores for African American students, and 89% showed gains in percentages proficient. 
*The years covered by these trends vary among states. Trends in some states begin later than 2002, although every state included in the table has at least three years of comparable test data ending in 2009. 

PP = Percentage proficient; MS = mean score 
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Slow and Uneven Progress in Narrowing Gaps 



For most student groups, achievement gaps on state 
tests have narrowed more often than they have 
widened. Trends for some groups are less positive. 

Tables 6 (reading) and 7 (math) show the percentages of states with sufficient 
data in which achievement gaps have narrowed, widened, or stayed the same at 
grades 4, 8, and high school. For most subgroups, gaps have narrowed since 
2002 in a majority of the states with sufficient data — particularly gaps in per- 
centages proficient. But this is not the case for all subgroups and all grade lev- 
els, especially when gaps are measured in terms of mean scores. 

As the tables indicate, gaps on state tests have narrowed more consistendy for African 
American and Latino students than for Native American, low-income, and male 
students. Gaps between African American and white students, and between Latino 
and white students, narrowed in the majority of states with sufficient data in both 
reading and math; this was the case at all three grade levels according to both per- 
centages proficient and mean scores. Even for these two groups, however, gaps in 
some grades and subjects widened or stayed the same in a sizeable minority of states. 
In grade 4 reading and math, for example, the black-white gap in mean scores 
widened in roughly 40% of the states with sufficient data. In grade 4 reading, the 
Latino-white gap increased in about one-third of the states with sufficient data. 

Progress in narrowing gaps has been more erratic for Native American and low- 
income students and for boys in reading. In most grade/subject combinations, 
gaps for these three groups narrowed in a majority of the states with sufficient 
data. But in grade 4 reading, gaps in mean scores for Native Americans, low- 
income students, and boys widened or stayed the same in a majority of the states 
with sufficient data. The same was true for Native American and low-income 
students in grade 4 math. And in high school reading and math, the gap in mean 
scores between Native American and white students narrowed in half the states 
with adequate data but widened or stayed the same in the other half. 



Usually when gaps narrowed, both subgroups improved but the lower-per- 
forming subgroup improved at a greater rate than the higher-performing one. 
Rising achievement for both groups, however, is no guarantee that gaps will 
shrink. When gaps widened, it was often because both subgroups made gains, 
but the higher- achieving group improved more rapidly than the lower- achiev- 
ing one. In other cases, gaps increased because the higher-achieving group made 
gains while the lower-achieving group had declining or flat performance. 
Occasionally, both groups posted declines, but the lower-performing group 
declined at a greater rate, thus widening the gap. 



Table 6. READING: Percentage of states with sufficient data showing various trends in achievement gaps on state tests, 2002-2009* 





African American/ White 


Latino/ White 


Native American/ White 


Low-Income/ Not Low-Income 


Male/ Female 


Grade 4 PP 


% of states gaps narrowed 


82 % 


78 % 


56 % 


74 % 


53 % 


% of states gaps widened 


18 % 


19 % 


38 % 


24 % 


35 % 


No change 


0 % 


3 % 


6 % 


3 % 


12 % 


# of states with data 


33 


37 


16 


38 


43 


Grade 4 MS 


% of states gaps narrowed 


54 % 


58 % 


27 % 


44 % 


42 % 


% of states gaps widened 


43 % 


32 % 


73 % 


38 % 


28 % 


No change 


4 % 


10 % 


0 % 


19 % 


31 % 


# of states with data 


28 


31 


15 


32 


36 


Grade 8 PP 


% of states gaps narrowed 


82 % 


89 % 


67 % 


66 % 


60 % 


% of states gaps widened 


12 % 


8 % 


22 % 


26 % 


33 % 


No change 


6 % 


3 % 


11 % 


8 % 


7 % 


# of states with data 


33 


36 


18 


38 


43 


Grade 8 MS 


% of states gaps narrowed 


57 % 


67 % 


53 % 


72 % 


58 % 


% of states gaps widened 


29 % 


27 % 


41 % 


19 % 


33 % 


No change 


14 % 


7 % 


6 % 


9 % 


8 % 


# of states with data 


27 


30 


17 


32 


36 


High school PP 


% of states gaps narrowed 


69% 


85 % 


71 % 


65 % 


74 % 


% of states gaps widened 


31 % 


15 % 


24 % 


18 % 


21 % 


No change 


0 % 


0 % 


6 % 


18 % 


5 % 


# of states with data 


29 


33 


17 


34 


38 


High school MS 


% of states gaps narrowed 


67 % 


85 % 


50 % 


66 % 


74 % 


% of states gaps widened 


21 % 


15 % 


43 % 


17 % 


16 % 


No change 


13 % 


0 % 


7 % 


17 % 


6 % 


# of states with data 


24 


27 


14 


29 


31 


Table reads: In grade 4 reading, the gap between African American and white students in percentages proficient on state tests narrowed in 82% of the 33 states with sufficient data and widened in 18% of these 
states. The African American-white gap in mean scores for grade 4 reading narrowed in 54% of the 28 states with sufficient data, widened in 43% of these states, and showed no net change in 4%. 

‘The years covered by these trends vary among states. Trends in some states begin later than 2002, although every state included in the table has at least three years of comparable test data ending in 2009. 

PP = Percentage proficient; MS = mean score 
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Table 7. MATHEMATICS: Percentage of states with sufficient data showing various trends in achievement gaps on state tests, 2002-2009* 





African American/ White 


Latino/ White 


Native American/ White 


Low-Income/ Not Low-Income 


Grade 4 PP 


% of states gaps narrowed 


88% 


83% 


65% 


79% 


% of states gaps widened 


13% 


14% 


29% 


18% 


No change 


0% 


3% 


6% 


3% 


# of states with data 


32 


36 


17 


38 


Grade 4 MS 


% of states gaps narrowed 


56% 


63% 


31% 


42% 


% of states gaps widened 


37% 


33% 


69% 


39% 


No change 


7% 


3% 


0% 


18% 


# of states with data 


27 


30 


16 


33 


Grade 8 PP 


% of states gaps narrowed 


78% 


86% 


58% 


74% 


% of states gaps widened 


19% 


9% 


37% 


24% 


No change 


3% 


6% 


5% 


3% 


# of states with data 


32 


35 


19 


38 


Grade 8 MS 


% of states gaps narrowed 


74% 


76 % 


61% 


64% 


% of states gaps widened 


15% 


17% 


33% 


27% 


No change 


11% 


7% 


6% 


9% 


# of states with data 


27 


29 


18 


33 


High school PP 


% of states gaps narrowed 


70% 


91% 


56% 


76 % 


% of states gaps widened 


23% 


6% 


28% 


15% 


No change 


7% 


3% 


17% 


9% 


# of states with data 


30 


34 


18 


34 


High school MS 


% of states gaps narrowed 


63% 


85% 


50% 


55% 


% of states gaps widened 


33% 


15% 


50% 


34% 


No change 


4% 


0% 


0% 


10% 


# of states with data 


24 


27 


14 


29 


Table reads: In grade 4 math, the gap between African American and white students in percentages proficient on state tests narrowed in 88% of the 32 states with sufficient data and widened in 13% of these 
states. The African American-white gap in mean scores in grade 4 math narrowed in 56% of the 27 states with sufficient data, widened in 37% of these states, and showed no net change in 7%. 

*The years covered by these trends vary among states. Trends in some states begin iaterthan 2002, although every state included in the table has at least three years of comparable test data ending in 2009. 
PP = Percentage proficient; MS = mean score 






Average test scores give a somewhat less positive 
picture of gaps narrowing. 



With percentages proficient, an achievement gap may appear smaller or larger 
depending on where a state has set its proficiency cut score. If the cut score is so 
low that nearly all students exceed it, or so high that few students reach it, achieve- 
ment gaps will appear smaller than if the cut score is set closer to the middle of 
the scoring scale, where most students’ scores cluster. The test data used in this 
study provide some evidence for this phenomenon. In the nine states in which the 
percentage proficient for white students in grade 4 reading exceeded 90%, the size 
of the African American-white gap averaged 14 percentage points. But in the 1 5 
states where the percentage proficient for white students was less than 80%, the 
size of the African American-white gap averaged 25 percentage points. The states 
with very high percentages proficient for white students may have lower cut scores 
and/or easier tests than those with lower percentages proficient. 

Mean scores, by contrast, are not tied to proficiency cut scores and show changes 
across the achievement spectrum, including changes above and below the pro- 
ficiency cut score. For this reason, mean scores are generally seen as a better indi- 
cator of changes in gaps than percentages proficient. This study also analyzed 
gaps in percentages proficient, however, because that is the indicator for which 
schools are held accountable under NCLB. 

Gaps in mean scores on state tests tended to narrow less often than gaps in per- 
centages proficient. This pattern, which is already evident in tables 6 and 7, 
becomes especially clear if one looks at trend lines across both subjects and all 
three grade levels. As shown in table 8, the proportion of trend lines with nar- 
rowing gaps was smaller using mean scores than using percentages proficient for 
all subgroups. The gap between low-income and non-low-income students, for 
instance, narrowed in 57% of the trend lines using mean scores, compared with 
72% of the trend lines using percentages proficient. The Native American-white 
gap narrowed in just 46% of the trend lines using mean scores but 62% of the 
trend lines using percentages proficient. 

The less positive findings for mean scores are unrelated to the fact that fewer 
states (and a somewhat different group of states) provided mean score data than 
provided percentages proficient. Rather, this pattern seems to be a result of mean 
scores picking up different kinds of changes in achievement. In some cases, a 



Table 8. Percentage of trend lines across two subjects and three 
grades levels that show achievement gaps narrowing on 
state tests, 2002-2009* 





African 

American/ 

White 


Latino/ 

Whte 


Native 

American/ 

White 


Low- 
Income/ 
Not Low- 
Income 


Male/ 

Female! 


% of MS trend lines narrowed 


61% 


72% 


46% 


57% 


58% 


% of PP trend lines narrowed 


78% 


85% 


62% 


72% 


62% 


Table reads: Across both reading and math and grades 4, 8, and high school, 61% of the trend lines 
analyzed using mean scores showed gaps narrowing between African American and white students, 
compared with 78% of trend lines using percentages proficient. 

‘The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 

tPercentages of male/female gaps narrowing are for reading only. 

PP = percentage proficient; MS = mean score 



lower- achieving subgroup made larger gains than a higher-achieving subgroup 
in percentages proficient but smaller gains in mean scores. In grade 4 math, for 
example, African American students made greater gains than white students in 
percentages proficient but smaller gains in mean scores. This could occur if large 
numbers of African American students improved their performance enough to 
move from just below the proficiency cut score to just above it or higher. If, dur- 
ing the same period, many students in the white subgroup were already scoring 
above the proficient level, then improvements in these students’ scores would not 
affect the white percentage proficient. Thus the black-white gap in percentages 
proficient might narrow while the mean score gap may stay the same or widen. 
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Slow and Uneven Progress in Narrowing Gaps 



Gaps have narrowed more rapidly for some groups 
than for others. Still, if progress were to continue 
at the current rates, it would take many years to 
close most gaps. 




How quickly are achievement gaps on state tests narrowing? To answer this ques- 
tion, we calculated the average yearly change in the gaps between various sub- 
groups in each of the states with sufficient data. If, for example, the percentage 
proficient gap between Native American and white students in a hypothetical 
state shrunk by 6 percentage points over the course of six years, then the aver- 
age yearly change in the gap would be 1 percentage point per year. We then 
determined the median, or midpoint, of these average yearly rates of change 
across all of the states with sufficient data for each subgroup. (By definition, half 
of the states have rates of change above this median and half have rates below.) 



Table 9 presents these medians. A bright spot among the data is the progress 
states have made since 2002 in narrowing percentage proficient gaps between 
Latino and white students. In most grade/subject combinations, Latino-white 
gaps narrowed more rapidly than gaps for other subgroups. In grade 8 reading, 
for example, the Latino-white gap in percentages proficient narrowed at a median 
rate of 1 .4 percentage points per year across the states with sufficient data. 



African American students tended to have the second highest median rates of 
progress in narrowing gaps, next to Latino students. In grade 4 math, the median 
change in the African American -white gap — 1.3 percentage points per year — 
exceeded the median for the Latino-white gap. For some grade/subject combi- 
nations, however, the median change in the African American-white gap was 
less than 1 percentage point per year. 



Other gaps have narrowed at a slower pace. The median rate at which the Native 
American-white gap has narrowed ranged from 0.3 percentage point per year in 
grade 4 reading to 0.7 percentage point per year in grade 8 math. The gap 
between low-income and non-low-income students has narrowed at a median 
rate that ranged from 0.5 to 0.7 percentage point per year, depending on the 
grade and subject. Progress in narrowing gaps between boys and girls in reading 
has been particularly slow, ranging from a median rate of no progress in grade 
4 to 0.5 percentage point per year in high school. 



Table 9. Progress in narrowing gaps in percentages proficient on 
state tests, in terms of median annual percentage point 
changes, 2002-2009* 





African 

American/ 

White 


Latino/ 

White 


Native 

American/ 

White 


Low- 
Income/ 
Not Low- 
Income 


Male/ 

Female 


Grade 4 reading 


Median percentage pt. change 


0.7 


0.8 


0.3 


0.5 


0.0 


# of states with data 


33 


37 


16 


38 


43 


Grade 8 reading 


Median percentage pt. change 


1.0 


1.4 


0.5 


0.6 


0.3 


# of states with data 


33 


36 


18 


38 


43 


High school reading 


Median percentage pt. change 


0.7 


1.2 


0.6 


0.7 


0.5 


# of states with data 


29 


33 


17 


34 


38 


Grade 4 math 


Median percentage pt. change 


1.3 


1.2 


0.4 


0.7 


NA 


# of states with data 


32 


36 


17 


39 




Grade 8 math 


Median percentage pt. change 


1.1 


1.3 


0.7 


0.6 


NA 


# of states with data 


32 


35 


19 


39 




High school math 


Median percentage pt. change 


0.7 


1.2 


0.5 


0.6 


NA 


# of states with data 


30 


34 


18 


35 




Table reads: On state grade 4 reading tests, the median rate of progress in narrowing the African 
American-white gap in percentages proficient was 0.7 percentage point peryear across ali 33 states 
with sufficient data for both subgroups. 


‘The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 





We also looked at the median rates of progress in narrowing gaps in mean scores, 
but the number of states with sufficient data was quite limited — 10 to 15 states, 
depending on the grade and subject. Fewer states provided the standard devia- 
tions needed to make these calculations than provided mean scores alone. In 
addition, these data did not always go back as far as the other data provided by 
states for this study. Because of these limitations, we could not reach firm con- 
clusions about how quickly or slowly mean score gaps were closing. 

One way of grasping what the current rates of progress signify is to consider hypo- 
thetically how long it would take to close typical-size gaps in specific states if that 
state s current rate of progress continued — which in reality is an unlikely scenario. 



Achievement trends for various groups rarely change at the same steady rate along a 
straight trajectory. In addition, the smaller a gap becomes, the more difficult it may 
be to close, as the very lowest-performing students struggle to master more chal- 
lenging knowledge and skills. Changes in tests, such as the adoption of tests that 
more sensitively measure the effects of good instruction, may influence the rate at 
which gaps change. With these points in mind, it is nevertheless illuminating to 
consider examples from states with typical-size gaps for particular subgroups, as 
shown in table 10. These examples come from states that did not have unusually 
large or small gaps and that had data for all the years covered by this study, 2002 
through 2009. States with longer trend lines offer a better opportunity to look at 
progress over time. 



Table 10. Hypothetical progress in closing achievement gaps in selected states, 2002-2009 





2002 PP 
lower- 
achieving 
subgroup 


2002 PP 
higher- 
achieving 
subgroup 


2002 

percentage 
point gap 


2009 PP 
lower- 
achieving 
subgroup 


2009 PP 
higher- 
achieving 
subgroup 


2009 

percentage 
point gap 


Average annual 
rate of closure 
in percentage 
points 


Hypothetical 
years to 
close gap 


African American/white gap, grade 4 reading 


Florida 


36% 


67% 


31 


59% 


84% 


25 


0.9 


28 


Louisiana 


42% 


73% 


31 


62% 


82% 


20 


1.6 


12.5 


Washington State 


49% 


71% 


22 


57% 


78% 


21 


0.2 


105 


Latino/white gap, grade 8 math 


Colorado 


45% 


80% 


35 


67% 


88% 


21 


2.0 


10.5 


Pennsylvania 


24% 


60% 


36 


52% 


77% 


25 


1.5 


17 


Native American/white gap, grade 4 reading 


Colorado 


80% 


92% 


12 


79% 


93% 


14 


-0.4 


Widening 


Low income/non-low income gap, grade 8 reading 


Pennsylvania 


31% 


68% 


37 


66% 


88% 


22 


2.0 


11 


Male/female gap, grade 8 reading 


Louisiana 


42% 


54% 


12 


57% 


69% 


12 


0 


Not closing 


Florida 


43% 


49% 


6 


50% 


58% 


8 


-0.3 


Widening 


Table reads: In Florida, the gap in percentages proficient between African American and white students narrowed from 31 percentage points in 2002 to 25 percentage points in 2009, an average rate of narrowing 
of 0.9 percentage point per year. If this current rate of change were to continue, it would take 28 years to close this gap. 


PP = Percentage proficient 
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Slow and Uneven Progress in Narrowing Gaps 



The examples in table 1 0 are offered for purposes of illustration, not prediction. 
They should not be used to compare one state with another, because states dif- 
fer considerably in the difficulty of their tests, the rigor of their cut scores for pro- 
ficiency, their student demographics, and many other factors. We used state 
examples because our data were not suitable for arriving at a “national” exam- 
ple of how long it would take to close gaps. Our data come from the subset of 
states with sufficient data for the analyses in this study, rather than from all states. 
The states included have different tests and cut scores, as noted above, and the 
data are not weighted for population size. 




In Florida, for example, a state with a typical-size gap, the African American- 
white gap in percentages proficient has narrowed in grade 4 reading at an aver- 
age rate of 0.9 percentage point per year since 2002. In 2009, this gap remained 
at 25 percentage points. If the gap continued to narrow at the same rate and if 
other key factors remained unchanged, then theoretically it would take 28 years 
to close this gap. In Washington State, the African American-white gap in grade 
4 reading has narrowed at an average rate of 0.2 percentage point per year, and 
amounted to 21 percentage points in 2009. Theoretically, it would take 105 
years to close this gap. 



In Pennsylvania, it would hypothetically take 17 years to close the gap between 
Latino and white students in grade 8 math at the current average rate of 1 .5 per- 
centage points per year. In Colorado, where the Latino-white gap has narrowed 
at the average rate of 2.0 percentage points per year, it would hypothetically take 
10.5 years to close this gap. 



In other cases, gaps have widened or stayed the same, so the current rate of 
change would not lead to a closing of these gaps. In Florida, for example, the 
male-female gap in grade 8 reading is 8 points, but this gap has widened since 
2002 at an average rate of 0.3 percentage point per year. 

As these examples indicate, the average rate of change varies considerably among 
states with similar size gaps, but these rates may be affected by differences in 
testing programs, demographics, and other factors. It is encouraging that gaps 
in some states are much smaller in 2009 than they were in 2002. But it could 
still take many years to close most gaps if progress were to continue unchanged, 
and some gaps would not narrow, let alone close. 



In sum, progress has been made in narrowing gaps, but much work remains to 
reduce disparities in educational quality and ensure that all groups of students — 
especially those with historically lower performance — acquire the knowledge 
and skills needed to succeed in higher education and the workplace. 



Chapter 2: African American Students 



Large achievement gaps remain between African 
American and white students on state tests. 

In many states, gaps of 20 or 30 points existed in 2009 between African 
American and white students in the percentages scoring proficient on state read- 
ing and math tests. These gaps on state tests are consistent with the wide black- 
white gaps found on NAEP and other achievement measures, as highlighted in 
a 2010 study by the Council of the Great City Schools. 1 

The size of the black-white gap varies considerably, however, from state to state. 
In high school math, for example, the largest gap in any state in 2009 was 50 per- 
centage points, while the smallest gap in any state was 8 points. These variations 
may not be solely, or even primarily, due to differences in educational quality but 
may also be attributable to differences among states in their cut scores for pro- 
ficiency, test difficulty, and other factors. The appendix shows the size of the 
black-white gaps for individual states in 2009. 

One way to gauge the relative performance of African American and white stu- 
dents on a broader scale than a single state is to look at the 2009 median per- 
centage proficient for each group across all of the states with sufficient data for 
both groups. (The median is the midpoint; by definition, half of the states with 
such data have percentages proficient above the median, and half have percent- 
ages proficient below it.) Table 11 shows these medians. In grade 8 math, for 
example, the median percentage proficient was 46% for African American stu- 
dents and 77% for white students, a difference of 31 points. Interestingly, 
African American students made the largest gains in grade 8 math, as discussed 
later. 

As table 1 1 also reveals, the range among states in percentages proficient was 
much greater for African Americans than for white students. In grade 4 math, 
for example, the African American percentage proficient ranged from 21% in the 
lowest state to 90% in the highest state, compared with a low of 5 1% and a high 
of 97% for white students. 

3 S. Lewis et al. (2010). A Call for Change: The Social and Educational Factors Contributing to the Outcomes of 
Black Males in Urban Schools. Washington, DC: Council of the Great City Schools. 



Table 11. Median, highest, and lowest percentages of AFRICAN 

AMERICAN and WHITE students scoring proficient across 
all states with sufficient state test data, 2009 





READING 


MATHEMATICS 




African American 


White 


African American 


White 


Grade 4 


Median PP across states 


59% 


84% 


59% 


84% 


Highest PP in any state 


88% 


97% 


90% 


97% 


Lowest PP in any state 


28% 


52% 


21% 


51% 


# of states with data 


40 


40 


40 


40 


Grade 8 


Median PP across states 


56% 


79% 


46% 


77% 


Highest PP in any state 


91% 


96% 


84% 


94% 


Lowest PP in any state 


27% 


56% 


20% 


53% 


# of states with data 


40 


40 


40 


40 


High school 


Median PP across states 


54% 


82% 


45% 


77% 


Highest PP in any state 


95% 


98% 


89% 


97% 


Lowest PP in any state 


18% 


47% 


7% 


33% 


# of states with data 


36 


36 


36 


36 


Table reads: Across all 40 states with sufficient 2009 data, the median percentage of African 
American students scoring proficient in grade 4 reading was 59%, compared with 84% for the white 
subgroup. The highest percentage proficient for grade 4 reading in any state for the African American 


subgroup was 88%, while the lowest in any state was 28%. 






PP = Percentage proficient 










NOTE: Forty states had sufficient 2009 data for both the African American and white subgroups at one 
or more grade levels: AL, AR, AZ, CA, CO, CT, DE, FL, GA, IA, IL, IN, KS, l<Y, LA, MA, MD, Ml, MN, M0, MS, 
NC, NE, NJ, NM, NV, NY, OH, OK, OR, PA, Rl, SC, TN, TX, UT, VA, WA, Wl, and WV. Together these states 
enroll 98% of the African American student population in the U.S. States with fewer than 500 African 
American test-takers in a particular grade/subject were excluded from the analysis for that 


grade/subject. 












Center on Education Policy 





Slow and Uneven Progress in Narrowing Gaps 



Many more states showed gains for African 
American students on state tests than 
showed declines. 



States with gains since 2002 for the African American subgroup far outnum- 
bered states with declines in both the percentages of students scoring proficient 
and average (mean) test scores. The most positive results were in grade 8 math: 
the African American subgroup posted increases in mean scores in every state and 
increases in percentages proficient in all but one state. 




According to percentages proficient, seven states showed declines for African 
Americans in high school math — the most declines of any grade/subject com- 
bination analyzed — but according to mean scores, just three states had declines 
for this subgroup. 



The proportions of trend lines with increases were similar using either percent- 
ages proficient or mean scores. Across both subjects and all three grade levels, 
89% of trend lines showed gains using percentages proficient, and 88% showed 
gains using mean scores. 



Table 12. Number (and percentage) of states with various trends for 
AFRICAN AMERICAN students on state tests, 2002-2009* 





READING 


MATHEMATICS 




Percentage 




Percentage 






proficient 


Mean score 


proficient 


Mean score 


Grade 4 


# and % of states with gain 


30 (88%) 


23 (79%) 


31 (94%) 


24 (86%) 


# and % of states with decline 


4(12%) 


3 (10%) 


2 (6%) 


4(14%) 


No change 


0 (0%) 


3 (10%) 


0 (0%) 


0 (0%) 


# of states with data 


34 


29 


33 


28 


Grade 8 


# and % of states with gain 


32 (94%) 


26 (90%) 


32 (97%) 


28(100%) 


# and % of states with decline 


2 (6%) 


2 (7%) 


1 (3%) 


0 (0%) 


No change 


0 (0%) 


1 (3%) 


0 (0%) 


0 (0%) 


# of states with data 


34 


29 


33 


28 


High school 


# and % of states with gain 


25 (83%) 


22 (88%) 


24 (77%) 


22 (88%) 


# and % of states with decline 


3 (10%) 


3(12%) 


7 (23%) 


3(12%) 


No change 


2 (7%) 


0 (0%) 


0 (0%) 


0 (0%) 


# of states with data 


30 


25 


31 


25 


Table reads: On state grade 4 reading tests, 30 of the 34 states with sufficient data showed gains 
since 2002 in the percentage of African American students scoring proficient, and 4 showed 
declines. Of the 29 states with sufficient mean score data, 23 showed gains for African American 
students in average grade 4 reading scores, 3 showed declines, and 3 had no net change. 


‘The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 


NOTE: Thirty-seven states had sufficient trend data for the African American subgroup at one or more 
grade levels: AL, AR, AZ, CA, CO, CT, DC, DE, FL, GA, IA, IL, KS, KY, LA, MA, MD, Ml, MN, MO, NC, NE, NJ, 
NM, NV, NY, OH, OR, PA, Rl, SC, TN, TX, UT, VA, WA, and Wl. Together these states enroll 95% of African 
American test-takers nationwide. States with fewer than 500 African American test-takers in a 
particular grade/subject or with fewer than three years of comparable test data were excluded from 


the analysis for that grade/subject. 











Progress in closing black-white achievement gaps 
is mixed. 



Gaps between African American and white students have narrowed since 2002 
in the majority of states with sufficient data, according to both percentages pro- 
ficient and mean scores. But mean scores, which capture changes across the 
achievement spectrum, tend to give a less positive picture of progress. Across both 
reading and math and all three grade levels, 78% of the black-white gaps analyzed 
narrowed according to percentages proficient, and 61% narrowed according to 
mean scores. In almost all cases where gaps narrowed, both subgroups improved, 
but African American students improved at a faster rate than white students. 

In both reading and math, gaps in mean scores between African American and 
white students widened most often at grade 4. Gaps widened for various reasons. 
Often, both subgroups showed gains, but white students improved at a greater 
rate than African American students. In grade 4 reading, for example, gains by 
white students outstripped gains by black students in 6 of the 12 instances where 
mean score gaps widened. In 5 of these 12 instances, white students made gains 
while the African American subgroup showed a decline or a flat trend. In one 
instance, mean scores declined for both groups, but declined more for African 
American students. 



Table 13. Number (and percentage) of states with various trends in 
the AFRICAN AMERICAN-WHITE achievement gap on state 
tests, 2002-2009* 





READING 


MATHEMATICS 




Percentage 

proficient 


Mean score 


Percentage 

proficient 


Mean score 


Grade 4 


# and % of states narrowed 


27 (82%) 


15(54%) 


28 (88%) 


15(56%) 


# and % of states widened 


6 (18%) 


12(43%) 


4(13%) 


10 (37%) 


No change 


0 (0%) 


1 (4%) 


0 (0%) 


2 (7%) 


# of states with data 


33 


28 


32 


27 


Grade 8 


# and % of states narrowed 


27 (82%) 


16(57%) 


25 (78%) 


20 (74%) 


# and % of states widened 


4(12%) 


8 (29%) 


6(19%) 


4(15%) 


No change 


2 (6%) 


4(14%) 


1 (3%) 


3(11%) 


# of states with data 


33 


28 


32 


27 


High school 


# and % of states narrowed 


20 (69%) 


16(67%) 


21 (70%) 


15(63%) 


# and % of states widened 


9 (31%) 


5 (21%) 


7(23%) 


8 (33%) 


No change 


0 (0%) 


3(13%) 


2 (7%) 


1 (4%) 


# of states with data 


29 


24 


30 


24 


Table reads: The gap between African American and white students in percentages scoring proficient 
on state grade 4 reading tests narrowed in 27 of the 33 states with sufficient data and widened in 6 
states. The African American-white gap in mean scores on grade 4 reading tests narrowed in 15 ofthe 
28 states with sufficient data, widened in 12 states, and showed no net change in 1 state. 


*The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 


NOTE: Thirty-six states had sufficient trend data for both the African American and white subgroups at 
one or more grade levels: AL, AR, AZ, CA, CO, CT, DE, FL, GA, IA, IL, KS, KY, LA, MA, MD, Ml, MN, M0, 

NC, NE, NJ, NM, NV, NY, OH, OR, PA, Rl, SC, TN,TX, UT, VA, WA, and Wl. Together these states enroll 
94% of African American test-takers nationwide. States with fewer than 500 African American test- 
takers in a particular grade/subject or with fewer than three years of comparable test data were 
excluded from the analysis for that grade/subject. 
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Slow and Uneven Progress in Narrowing Gaps 



Chapter 3: Asian American Students 



Since 2002, the Asian subgroup has made gains 
on reading and math tests in many states. 



Four-fifths or more of the states with sufficient data posted increases for Asian 
American students in both the percentages scoring proficient and average (mean) 
test scores. Across both reading and math and all three grade levels, 85% of the 
total trend lines analyzed showed gains using percentages proficient, and 90% 
showed gains using mean scores. 




Gains for the Asian subgroup were most prevalent in grade 8 math: mean scores 
rose in all 24 states with sufficient data, and percentages proficient went up in 
27 of 29 states. 



More states saw decreases in performance for Asian students in reading than 
in math. 



Table 14. Number (and percentage) of states with various trends for 
ASIAN AMERICAN students on state tests, 2002-2009* 





READING 


MATHEMATICS 




Percentage 

proficient 


Mean score 


Percentage 

proficient 


Mean score 


Grade 4 


# and % of states with gain 


26 ( 84 %) 


22 ( 85 %) 


26 ( 87 %) 


23 ( 92 %) 


# and % of states with decline 


4 ( 13 %) 


3 ( 12 %) 


2 ( 7 %) 


2 ( 8 %) 


No change 


1 ( 3 %) 


1 ( 4 %) 


2 ( 7 %) 


0 ( 0 %) 


# of states with data 


31 


26 


30 


25 


Grade 8 


# and % of states with gain 


25 ( 83 %) 


21 ( 84 %) 


27 ( 93 %) 


24 ( 100 %) 


# and % of states with decline 


4 ( 13 %) 


4 ( 16 %) 


1 ( 3 %) 


0 ( 0 %) 


No change 


1 ( 3 %) 


0 ( 0 %) 


1 ( 3 %) 


0 ( 0 %) 


# of states with data 


30 


25 


29 


24 


High school 


# and % of states with gain 


23 ( 82 %) 


20 ( 87 %) 


24 ( 83 %) 


21 ( 91 %) 


# and % of states with decline 


4 ( 14 %) 


3 ( 13 %) 


4 ( 14 %) 


2 ( 9 %) 


No change 


1 ( 4 %) 


0 ( 0 %) 


1 ( 3 %) 


0 ( 0 %) 


# of states with data 


28 


23 


29 


23 


Table reads: On state grade 4 reading tests, 26 of the 31 states with sufficient data showed gains 
since 2002 in the percentage of Asian students scoring proficient, 4 showed declines, and 1 showed 
no net change. Of the 26 states with sufficient mean score data, 22 showed gains for Asian students 
in average grade 4 reading scores, 3 showed declines, and 1 state showed no net change. 

‘The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 

NOTE: Thirty-five states had sufficient trend data for the Asian subgroup atone or more grade levels: 
AK, AL, AR, AZ, CA, CO, CT, FL, GA, HI, IA, IL, KS, KY, LA, MA, MD, Ml, MN, MO, NC, NJ, NV, NY, OH, OK, 
OR, PA, SC, TN,TX, UT, VA, WA, and Wl. Together these states enroll 98% of Asian test-takers 
nationwide. States with fewer than 500 Asian test-takers in a particular grade/subject or with fewer 
than three years of comparable test data were excluded from the analysis for that grade/subject. 





In math, Asian American students often outperform 
white students and other racial/ethnic subgroups 
on state tests. 



In at least three-quarters of the states with sufficient 2009 data for the Asian and 
white subgroups, Asian students had higher percentages proficient and mean 
scores in math than white students and other racial/ethnic groups. Table 15 
shows the specific numbers and percentages of states in which the Asian sub- 
group outperformed the white subgroup in math in 2009. 



Table 15. Number and percentage of states in which ASIAN 

AMERICAN students outperformed WHITE students in 
mathematics, 2009 





PERCENTAGE PROFICIENT 




MEAN SCORE 






# of 
states 
Asian > 
white 


% of 
states 
Asian > 
white 


tt of 
states 
with data 


# of 
states 
Asian > 
white 


%of 
states 
Asian > 
white 


it of 
states 
with data 


Grade 4 


28 


78% 


36 


22 


85% 


26 


Grade 8 


29 


83% 


35 


21 


84% 


25 


High school 


24 


75% 


32 


21 


88% 


24 


Table reads: On state grade 4 math tests, a higher percentage of Asian students than of white 
students scored at or above the proficient level in 28 of the 36 states with sufficient data for both 
subgroups, or in 78% of these states. 

NOTE: Thirty-six states had sufficient 2009 test data for both the Asian and white subgroups at one or 
more grade levels: AK, AL, AR, AZ, CA, CO, CT, FL, GA, HI, IA, IL, IN, KS, KY, LA, MA, MD, Ml, MN, M0, 

NC, NJ, NV, NY, OH, OK, OR, PA, SC, TN, TX, UT, VA, WA, and Wl. Together these states enroll about 98% 
of Asian test-takers nationwide. States with fewer than 500 Asian test-takers in a particular 
grade/subject were excluded from the analysis for that grade/subject. 



In many states, the percentage of Asian students scoring proficient in math was 
at least 10 points higher than that of white students. At the high school level, this 
was the case in seven states (California, Illinois, Michigan, Missouri, 
Pennsylvania, South Carolina, and Texas). The appendix provides more details 
about Asian students’ performance in individual states in 2009. 

One way to gauge the relative performance of Asian American and white stu- 
dents on a broader scale than a single state is to look at the median percentage pro- 
ficient for 2009 across all of the states with sufficient data for both groups. (The 
median is the midpoint; by definition, half of the states with such data have per- 
centages proficient above the median, and half have percentages proficient below 
it.) As shown in table 16, the median percentages proficient in math were higher 
for the Asian subgroup than for the white subgroup at all three grade levels. 



Table 16. Median, highest, and lowest percentages proficient in 
mathematics for ASIAN AMERICAN and WHITE students 
across all states with sufficient state test data, 2009 
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Slow and Uneven Progress in Narrowing Gaps 



On state reading tests, the Asian and white 
subgroups often perform at similar levels, although 
differences exist by grade level and by indicator 
used (average scores or percentages proficient). 




At grades 4 and 8, Asian students had higher mean scores in 2009 than white stu- 
dents in most of the states with sufficient data, as shown in table 17. But percent- 
ages proficient at these grades present a different picture: the number of states in 
which Asian students outperformed whites was similar to the number in which 
white students outperformed Asians. At the high school level, Asian students also 
had higher mean scores than whites in most of the states with sufficient data. In 
terms of percentages proficient, however, white students had the edge in more states. 



Table 17. Number and percentage of states in which ASIAN 

AMERICAN students outperformed white students in 
reading, 2009 





PERCENTAGE PROFICIENT 




MEAN SCORE 






# of 
states 
Asian > 
white 


% of 
states 
Asian > 
white 


# 0 / 
states 
with data 


ft of 
states 
Asian > 
white 


%of 
states 
Asian > 
white 


#of 
states 
with data 


Grade 4 


18 


50% 


36 


18 


69% 


26 


Grade 8 


19 


54% 


35 


19 


76% 


25 


High school 


11 


34% 


32 


14 


61% 


23 


Table reads: On state grade 4 reading tests, a higher percentage of Asian students than of white 
students scored at or above the proficient level in 18 of the 36 states with sufficient data for both 
subgroups, or in 50% of these states. 

NOTE: Thirty-six states had sufficient 2009 test data for both the Asian and white subgroups at one or 
more grade levels: AK, AL, AR, AZ, CA, CO, CT, FL, GA, HI, IA, IL, IN, KS, KY, LA, MA, MD, Ml, MN, MO, 

NC, NJ, NV, NY, OH, OK, OR, PA, SC, TN, TX, UT, VA, WA, and Wl. Together these states enroll about 98% 
of Asian test-takers nationwide. States with fewer than 500 Asian test-takers in a particular 
grade/subject were excluded from the analysis for that grade/subject. 



What accounts for these differences by indicator? In several states, the Asian sub- 
group had slightly lower percentages proficient than whites but slightly higher 
mean scores. In Connecticut, for instance, 90% of whites and 88% of Asians 
scored at or above the proficient level in high school reading/language arts; mean 
scores, however, were 257 for whites and 260 for Asians. Patterns like this indi- 
cate that among the top performers — students who scored above the proficient 
level — Asian students tended to earn higher scores than their white counterparts. 

One way of gauging the relative performance of Asian American and white stu- 
dents across multiple states is to look at the median percentage proficient for 
2009 across all of the states with sufficient data for both groups. Table 18 shows 
the results. At grades 4 and 8, the median percentages proficient in reading across 
states were the same or quite similar for the Asian and white subgroups, but at 
the high school level, the median was slightly lower for Asians. 



Table 18. Median, highest, and lowest percentages proficient in 

reading for ASIAN AMERICAN and WHITE students across 
all states with sufficient state test data, 2009 








Chapter 4: Latino Students 



States continue to confront large Latino-white 
achievement gaps on state reading and math tests. 

In many states, gaps of 1 5 to 20 percentage points or more existed between 
Latino and white students in the percentages scoring proficient in 2009. The size 
of the Latino-white gap varied considerably, however, from state to state. In 
grade 4 reading, for example, the largest gap in any state in 2009 was 38 per- 
centage points, while the smallest gap in any state was 5 points. These variations 
may not be solely, or even primarily, due to differences in educational quality but 
may also be attributable to differences among states in their cut scores for pro- 
ficiency, test difficulty, and other factors. The appendix shows the size of the 
Latino-white gaps in specific states in 2009. 

One way to gauge the relative performance of Latino and white students on a 
broader scale than a single state is to look at the median percentage proficient 
for 2009 across all of the states with sufficient data for both groups. (The median 
is the midpoint; by definition, half of the states with such data have percentages 
proficient above the median, and half have percentages proficient below it.) The 
results are shown in table 19. In high school reading/language arts, for exam- 
ple, the median percentage proficient was 62% for Latino students and 83% 
for white students, a difference of more than 20 percentage points. Similar dif- 
ferences can be found for other grade/subject combinations. 

As table 19 also indicates, the range among states in percentages proficient was 
much greater for Latino students than for white students. In grade 8 math, for 
example, the Latino percentage proficient ranged from 22% in the lowest state 
to 87% in the highest state, compared with a low of 53% and a high of 94% for 
white students. 



Table 19. Median, highest, and lowest percentages of LATINO and 
WHITE students scoring proficient across all states with 
sufficient state test data, 2009 





READING 


MATHEMATICS 




Latino 


White 


Latino 


White 


Grade 4 


Median PP across states 


62% 


84% 


67% 


84% 


Highest PP in any state 


92% 


97% 


94% 


97% 


Lowest PP in any state 


28% 


52% 


25% 


51% 


# of states with data 


43 


43 


43 


43 


Grade 8 


Median PP across states 


60% 


80% 


58% 


11 % 


Highest PP in any state 


92% 


96% 


87% 


94% 


Lowest PP in any state 


34% 


56% 


22% 


53% 


# of states with data 


42 


42 


42 


42 


High school 


Median PP across states 


62% 


83% 


54% 


77 % 


Highest PP in any state 


97% 


98% 


93% 


97% 


Lowest PP in any state 


30% 


48% 


9% 


33% 


# of states with data 


38 


38 


39 


39 


Table reads: Across all 43 states with sufficient 2009 data, the median percentage of Latino students 
scoring proficient in grade 4 reading was 62%, compared with 84% for the white subgroup. The 
highest percentage proficient for grade 4 reading in any state for the Latino subgroup was 92%, while 


the lowest in any state was 28%. 
PP = Percentage proficient 










NOTE: Forty-three states had sufficient 2009 data for both the Latino and white subgroups for one or 
more grade/subject combinations: AK, AL, AR, AZ, CA, CO, CT, DE, FL, GA, IA, ID, IL, IN, KS, KY, LA, MA, 
MD, Ml, MN, MO, MS, NC, NE, NH, NJ, NM, NV, NY, OH, OK, OR, PA, Rl, SC, TN, TX, UT, VA, WA, Wl, and 
WY. Together these states enroll almost 100% of the Latino student population in the U.S. States with 
fewer than 500 Latino test-takers in a particular grade/subject were excluded from the analysis for 


that grade/subject. 
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Slow and Uneven Progress in Narrowing Gaps 



The number of states with test score gains for 
Latino students since 2002 far exceeds the 
number with declines. 



Many more states have shown increases for Latino students on state reading and 
math tests since 2002 than have experienced decreases, according to both the 
percentages of students scoring proficient and average (mean) test scores. The 
most positive results were in grade 8 math; in every state with sufficient data, the 
Latino subgroup posted gains in both mean scores and percentages proficient. 




Declines for Latino students were more evident in reading than in math, 
although a relatively small number of states showed declines in either subject. 

Trends in percentages proficient and mean scores were generally similar for 
Latino students. Across two subjects and three grade levels, 93% of the trend 
lines analyzed showed gains using percentages proficient, and 90% showed gains 
using mean scores. 



Table 20. Number (and percentage) of states with various trends for 
LATINO students on state tests, 2002-2009* 





READING 


MATHEMATICS 




Percentage 




Percentage 






proficient 


Mean score 


proficient 


Mean score 


Grade 4 


# and % of states with gain 


33 (89%) 


26 (84%) 


34 (92%) 


28 (90%) 


# and % of states with decline 


4(11%) 


5(16%) 


1 (3%) 


3 (10%) 


No change 


0 (0%) 


0 (0%) 


2 (5%) 


0 (0%) 


# of states with data 


37 


31 


37 


31 


Grade 8 


# and % of states with gain 


33 (92%) 


26(87%) 


35 (100%) 


29(100%) 


# and % of states with decline 


3 (8%) 


4(13%) 


0 (0%) 


0 (0%) 


No change 


0 (0%) 


0 (0%) 


0 (0%) 


0 (0%) 


# of states with data 


36 


30 


35 


29 


High school 


# and % of states with gain 


30 (91%) 


23 (85%) 


33 (97%) 


25 (93%) 


# and % of states with decline 


2 (6%) 


3(11%) 


1 (3%) 


2 (7%) 


No change 


1 (3%) 


1 (4%) 


0 (0%) 


0 (0%) 


# of states with data 


33 


27 


34 


27 


Table reads: On state grade 4 reading tests, 33 of the 37 states with sufficient data showed gains 
since 2002 in the percentage of Latino students scoring proficient, and 4 showed declines. Of the 31 
states with sufficient mean score data, 26 showed gains for Latino students in average grade 4 


reading scores, and 5 showed declines. 








*The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 


NOTE: Forty-one states had sufficient trend data for the Latino subgroup for one or more 
grade/subject combinations: AK, AL, AR, AZ, CA, CO, CT, DC, DE, FL, GA, IA, ID, IL, KS, KY, LA, MA, MD, 
Ml, MN, M0, NC, NE, NH, NJ, NM, NV, NY, OH, OR, PA, Rl, SC, TN, TX, UT, VA, WA, Wl, and WY. Together 
these states enroll 98% of Latino test-takers nationwide. States with fewer than 500 Latino test- 
takers in a particular grade/subject or with fewer than three years of comparable test data were 


excluded from the analysis for that grade/subject. 











Progress in narrowing Latino-white gaps is mixed. 



State test score gaps between Latino and white students have narrowed since 
2002 in the majority of states with sufficient data. In almost all cases where gaps 
have narrowed, both the Latino and white subgroups have improved, but Latinos 
have improved at a faster rate. 

These positive results are tempered, however, by the notable number of instances 
in which Latino-white gaps have widened, especially gaps in mean scores. Across 
both subjects and all three grades levels, 72% of mean score gaps narrowed, com- 
pared with 85% of percentage proficient gaps. 

Instances of widening Latino-white gaps were most common in grade 4; at this 
level, mean score gaps widened about one-third of the time. Latinos made the 
most progress in narrowing gaps at the high school level, where the Latino-white 
gap widened in just 15% of instances or fewer. 

Gaps widened for various reasons. Often, both subgroups improved, but the white 
subgroup made greater gains than the Latino subgroup. In grade 4 math, for exam- 
ple, gains by white students outpaced gains by Latino students in 8 of the 10 
instances of widening mean score gaps. In the remaining two instances, perform- 
ance improved for the white subgroup but declined for the Latino subgroup. 



Table 21. Number (and percentage) of states with various trends in 
the LATINO-WHITE achievement gap on state tests, 
2002-2009* 





READING 


MATHEMATICS 




Percentage 




Percentage 






proficient 


Mean score 


proficient 


Mean score 


Grade 4 


# and % of states narrowed 


29 (78%) 


18(58%) 


30 (83%) 


19(63%) 


# and % of states widened 


7(19%) 


10(32%) 


5 (14%) 


10(33%) 


No change 


1 (3%) 


3(10%) 


1 (3%) 


1 (3%) 


# of states with data 


37 


31 


36 


30 


Grade 8 


# and % of states narrowed 


32 (89%) 


20 (67%) 


30 (86%) 


22 (76%) 


# and % of states widened 


3 (8%) 


8(27%) 


3 (9%) 


5(17%) 


No change 


1 (3%) 


2 (7%) 


2 (6%) 


2 (7%) 


# of states with data 


36 


30 


35 


29 


High school 


# and % of states narrowed 


28 (85%) 


23 (85%) 


31 (91%) 


23 (85%) 


# and % of states widened 


5(15%) 


4(15%) 


2 (6%) 


4(15%) 


No change 


0 (0%) 


0 (0%) 


1 (3%) 


0 (0%) 


# of states with data 


33 


27 


34 


27 


Table reads: The gap between Latino and white students in percentages scoring proficient on state 
grade 4 readingtests narrowed in 29 of the 37 states with sufficient data, widened in 7 states, and 
showed no net change in 1 state. The Latino-white gap in mean scores on grade 4 readingtests 
narrowed in 18 of the 31 states with sufficient data, widened in 10 states, and showed no net 


change in 3 states. 










*The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 


NOTE: Forty-one states had sufficient trend data for both the Latino and white subgroups for one or 
more grade/subject combinations: AK, AL, AR, AZ, CA, CO, CT, DE, FL, GA, IA, ID, IL, KS, KY, LA, MA, MD, 
Ml, MN, M0, NC, NE, NH, NJ, NM, NV, NY, OH, OK, OR, PA, Rl, SC, TN, TX, UT, VA, WA, Wl, and WY. 
Together these states enroll 98% of Latino test-takers nationwide. States with fewer than 500 Latino 
test-takers in a particular grade/subject or with fewer than three years of comparable test data were 


excluded from the analysis for that grade/subject. 
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Slow and Uneven Progress in Narrowing Gaps 



Chapter 5: Native American Students 




Performance gaps on state tests between Native 
American and white students remain wide in 
many states. 

In many of the 22 states with sufficiently large numbers of Native American 
test-takers, gaps in percentages proficient between Native American and white 
students amounted to 20 or even 30 percentage points on state 2009 reading and 
math tests. But in some states, these gaps totaled 10 percentage points or less. 
The size of the Native American-white gaps varied enormously from state to 
state. In high school math, for example, the largest gap in any state was 36 per- 
centage points, while in another state there was no gap. 

These variations may not be solely, or even primarily, the result of differences in 
educational quality but may also be attributable to differences among states in 
their cut scores for proficiency, test difficulty, and other factors. The appendix 
shows the size of the Native American-white gaps for individual states in 2009. 

One way to gauge the relative performance of Native American and white stu- 
dents on a broader scale than a single state is to look at the median percentage 
proficient for 2009 across all of the states with sufficient data for both groups. 
(The median is the midpoint; by definition, half of the states with such data 
have percentages proficient above the median, and half have percentages profi- 
cient below it.) The results are shown in table 22. In grade 4 reading, for exam- 
ple, the median percentage proficient was 58% for Native American students 
and 84% for white students. The range from the lowest percentage proficient in 
any state to the highest in any state was also greater for Native Americans than 
for white students. 



Table 22. Median, highest, and lowest percentages proficient for 
NATIVE AMERICAN and WHITE students across all states 
with sufficient state test data, 2009 





READING 


MATHEMATICS 




Native 




Native 






American 


White 


American 


White 


Grade 4 


Median PP across states 


58% 


84% 


62% 


83% 


Highest PP in any state 


86% 


93% 


87% 


96% 


Lowest PP in any state 


36% 


63% 


29% 


59% 


# of states with data 


19 


19 


19 


19 


Grade 8 


Median PP across states 


59% 


79% 


51% 


76% 


Highest PP in any state 


94% 


96% 


79% 


89% 


Lowest PP in any state 


39% 


66% 


28% 


56% 


# of states with data 


21 


21 


21 


21 


High school 


Median PP across states 


54% 


82% 




69 % 


Highest PP in any state 


96% 


97% 


92% 


94% 


Lowest PP in any state 


37% 


48% 


18% 


47% 


# of states with data 


19 


19 


19 


19 


Table reads: Across all 19 states with sufficient data, the median percentage of Native American 
students scoring proficient in grade 4 reading was 58%, compared with 84% for the white subgroup. 
The highest percentage proficient for grade 4 reading in any state for the Native American subgroup 


was 86%, while the lowest in any state was 36%. 








PP = Percentage proficient 










NOTE: Twenty-two states had sufficient 2009 test data for both the Native American and white 
subgroups at one or more grade levels: AK, AL, AZ, CA, CO, FL, Ml, MN, MT, NC, ND, NM, NV, NY, OK, 
OR, SD, TX, UT, VA, WA, and Wl. Together these states enroll about 88% of the Native American 
student population in the U.S. States with fewer than 500 Native American test-takers in a particular 


grade/subject were excluded from the analysis for that grade/subject. 







States with gains on state tests for Native 
Americans outnumber those with declines. 



The reading and math performance of the Native American subgroup has 
improved since 2002 in two-thirds or more of the states with sufficient test data. 
A large majority of these states made gains for Native Americans on two indica- 
tors — average (mean) test scores and percentages scoring proficient. Across both 
subjects and all three grade levels, 86% of the trend lines we analyzed showed 
gains using percentages proficient, and 80% had gains using mean scores. 

Our analysis of Native American gap trends was limited to the minority of states 
with large enough Native American subgroups to yield reliable trend informa- 
tion and sufficient years of comparable test data — from 14 to 19 states, depend- 
ing on the grade level and subject. 



Table 23. Number (and percentage) of states with various trends for 
NATIVE AMERICAN students on state tests, 2002-2009* 





READING 


MATHEMATICS 




Percentage 




Percentage 






proficient 


Mean score 


proficient 


Mean score 


Grade 4 


# and % of states with gain 


13(81%) 


10(67%) 


14(82%) 


13(81%) 


# and % of states with decline 


3 (19%) 


3 (20%) 


2(12%) 


3(19%) 


No change 


0 (0%) 


2(13%) 


1 (6%) 


0 (0%) 


# of states with data 


16 


15 


17 


16 


Grade 8 


# and % of states with gain 


16(89%) 


14(82%) 


18(95%) 


16(89%) 


# and % of states with decline 


2(11%) 


2(12%) 


1 (5%) 


2(11%) 


No change 


0 (0%) 


1 (6%) 


0 (0%) 


0 (0%) 


# of states with data 


18 


17 


19 


18 


High school 


# and % of states with gain 


14(82%) 


12(86%) 


15(83%) 


10(71%) 


# and % of states with decline 


2(12%) 


2 (14%) 


2(11%) 


4 (29%) 


No change 


1 (6%) 


0 (0%) 


1 (6%) 


0 (0%) 


# of states with data 


17 


14 


18 


14 


Table reads: On state grade 4 reading tests, 13 of the 16 states with sufficient data showed gains 
since 2002 in the percentage of Native American students scoring proficient, and 3 showed declines. 
Of the 15 states with sufficient mean score data, 10 showed gains for Native American students in 


average grade 4 reading scores, 3 showed declines, and 2 had no net change. 




*The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 


NOTE: Twenty-two states had sufficient trend data for the Native American subgroup at one or more 
grade levels: AK, AL, AZ, CA, CO, FL, Ml, MN, MT, NC, ND, NM, NV, NY, OK, OR, SD, TX, UT, VA, WA, and 
Wl. These states enroll 88% of Native American test-takers nationwide. States with fewer than 500 
Native American test-takers in a particular grade/subject or with fewer than three years of 


comparable test data were excluded from the analysis for that grade/subject. 
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Slow and Uneven Progress in Narrowing Gaps 



Less progress has been made in narrowing 
achievement gaps on state tests for Native 
Americans than for other racial/ethnic groups. 



Although Native American-white gaps have narrowed in some states and grade 
levels, progress has been erratic, especially as gauged by mean scores. Across two 
subjects and three grade levels, 62% of the percentage proficient gaps between 
Native American and white students narrowed, and 46% of the mean score gaps 
narrowed. In most cases where gaps narrowed, both subgroups improved, but 
Native American students improved at a faster rate than white students. 

For some grades and subjects, the Native American-white gap widened at least 
2 fT) as often as it narrowed. In grade 4 reading and math, for example, mean score 
gaps widened in more than two-thirds of the states with sufficient data. In high 
school reading/language arts and math, the number of states with widening gaps 
in mean scores was the same as the number with narrowing or stable gaps. Gaps 
widened for various reasons. Often, both subgroups showed gains, but white 
students improved at a faster rate than Native Americans. In grade 4 math, for 
example, gains by white students outstripped gains by Native American students 
in 8 of the 1 1 instances where mean score gaps widened. In 2 of these 1 1 
instances, the performance of white students improved while the Native 
American subgroup showed a decline. In one instance, mean scores declined for 
both groups but declined more for Native American students. 



Table 24. Number (and percentage) of states with various trends in 
the NATIVE AMERICAN-WHITE achievement gap on state 
tests, 2002-2009* 





READING 


MATHEMATICS 




Percentage 




Percentage 






proficient 


Mean score 


proficient 


Mean score 


Grade 4 


# and % of states narrowed 


9 (56%) 


4 (27%) 


11(65%) 


5 (31%) 


# and % of states widened 


6 (38%) 


11 (73%) 


5 (29%) 


11(69%) 


No change 


1 (6%) 


0 (0%) 


1 (6%) 


0 (0%) 


# of states with data 


16 


15 


17 


16 


Grade 8 


# and % of states narrowed 


12(67%) 


9 (53%) 


11 (58%) 


11 (61%) 


# and % of states widened 


4 (22%) 


7(41%) 


7(37%) 


6 (33%) 


No change 


2(11%) 


1 (6%) 


1 (5%) 


1 (6%) 


# of states with data 


18 


17 


19 


18 


High school 


# and % of states narrowed 


12(71%) 


7 (50%) 


10(56%) 


1 (50%) 


# and % of states widened 


4 (24%) 


6 (43%) 


5 (28%) 


7 (50%) 


No change 


1 (6%) 


1 (7%) 


3(17%) 


0 


# of states with data 


17 


14 


18 


14 


Table reads: The gap between Native American and white students in percentages scoring proficient 
on state grade 4 reading tests narrowed in 9 of the 16 states with sufficient data, widened in 6 
states, and showed no net change in 1 state. The Native American-white gap in mean scores on grade 
4 reading tests narrowed in 4 of the 15 states with sufficient data and widened in 11 states. 


‘The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 


NOTE: Twenty-two states had sufficient trend data for both the Native American and white subgroups 
at one or more grade levels: AK, AL, AZ, CA, CO, FL, Ml, MN, MT, NC, ND, NM, NV, NY, OK, OR, SD, TX, 
UT, VA, WA, and Wl. These states enroll 88% of Native American test-takers nationwide. States with 
fewer than 500 Native American test-takers in a particular grade/subject or with fewer than three 


years of comparable test data were excluded from the analysis for that grade/subject. 







Chapter 6: White Students 



States with gains for white students on state 
reading and math tests greatly outnumbered 
states with declines. 

The vast majority of states with sufficient years of trend data showed gains since 
2002 for the white subgroup in both percentages proficient and average (mean) test 
scores. Trends on these two indicators were generally similar. Across both subjects 
and three grade levels, 9 1 % of the trend lines analyzed showed gains for white stu- 
dents using percentages proficient, and 88% showed gains using mean scores. 

The most positive results for white students were in math at grades 4 and 8: in 
almost all of the states with sufficient data, this subgroup showed gains in per- 
centages proficient and mean scores. Declines in performance for white students 
occurred most often at the high school level in both reading and math. 

In reading, white students and Asian students often showed similar test results, 
outperforming other racial/ethnic groups. In math, white students outperformed 
other groups except for Asians. 

More states had sufficient test data for white students than for other racial/eth- 
nic subgroups. One way to gauge the performance of white students is to look 
at the median percentages proficient for this subgroup across all of the states 
with such data. (The median is the midpoint; by definition, half of the states 
with such data have percentages proficient above the median, and half have per- 
centages proficient below it.) The 2009 median percentages proficient for white 
students were 84% in grade 4 reading, 84% in grade 4 math, 79% in grade 8 
reading/language arts, 77% in grade 8 math, 8 1 % in high school reading/lan- 
guage arts, and 75% in high school math. The appendix provides more details 
about the performance of white students in individual states in 2009. 



Table 25. Number (and percentage) of states with various trends for 
WHITE students on state tests, 2002-2009* 





READING 


MATHEMATICS 




Percentage 

proficient 


Mean score 


Percentage 

proficient 


Mean score 


Grade 4 


# and % of states with gain 


37 ( 88 %) 


33 ( 92 %) 


41 ( 98 %) 


35 ( 97 %) 


# and % of states with decline 


1 ( 2 %) 


2 ( 6 %) 


1 ( 2 %) 


1 ( 3 %) 


No change 


4 ( 10 %) 


1 ( 3 %) 


0 ( 0 %) 


0 ( 0 %) 


# of states with data 


42 


36 


42 


36 


Grade 8 


# and % of states with gain 


39 ( 93 %) 


33 ( 92 %) 


41 ( 98 %) 


34 ( 94 %) 


# and % of states with decline 


3 ( 7 %) 


3 ( 8 %) 


1 ( 2 %) 


1 ( 3 %) 


No change 


0 ( 0 %) 


0 ( 0 %) 


0 ( 0 %) 


1 ( 3 %) 


# of states with data 


42 


36 


42 


36 


High school 


# and % of states with gain 


34 ( 92 %) 


24 ( 77 %) 


30 ( 77 %) 


24 ( 75 %) 


# and % of states with decline 


3 ( 8 %) 


5 ( 16 %) 


7 ( 18 %) 


4 ( 13 %) 


No change 


0 ( 0 %) 


2 ( 6 %) 


2 ( 5 %) 


4 ( 13 %) 


# of states with data 


37 


31 


39 


32 


Table reads: On state grade 4 reading tests, 37 of the 42 states with sufficient data showed gains 
since 2002 in the percentage of white students scoring proficient, 1 showed a decline, and 4 showed 
no net change. Of the 36 states with sufficient mean score data, 33 showed gains for white students 
in average grade 4 reading scores, 2 showed declines, and 1 had no net change. 

*The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 

NOTE: Forty-seven states had sufficient trend data for the white subgroup at one or more grade levels: 
AK, AL, AR, AZ, CA, CO, CT, DE, FL, GA, HI, IA, ID, IL, KS, KY, LA, MA, MD, ME, Ml, MN, MO, MT, NC, ND, NE, 
NH, NJ, NM, NV, NY, OH, OK, OR, PA, Rl, SC, SD, TN, TX, UT, VA, VT, WA, Wl, and WY. Together these states 
enroll 91% of the white student population in the U.S. States with fewer than three years of comparable 
test data in a particular grade/subject were excluded from the analysis for that grade/subject. 
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Slow and Uneven Progress in Narrowing Gaps 



Chapter 7: Low-Income Students 




Sizeable achievement gaps exist between 
students from low-income families and more 
advantaged students. 

Within individual states, the gaps in percentages proficient between students who 
come from low-income families and those who do not often amounted to 25 
percentage points in 2009. The size of these gaps varied considerably, however, 
from state to state. In high school math, for example, the largest gap between 
low-income and non-low-income students in any state was 37 percentage points, 
while the smallest gap in any state was 6 points. These variations may not be 
solely, or even primarily, due to differences in educational quality, but may also 
be attributable to differences among states in their cut scores for proficiency, test 
difficulty, and other factors. The appendix shows the size of the gaps between 
low-income and non-low-income students in specific states in 2009. 

One way to gauge the relative performance of low-income and non-low-income 
students on a broader scale than a single state is to look at the median percent- 
age proficient for 2009 across all of the states with sufficient data for both groups. 
(The median is the midpoint; by definition, half of the states with such data 
have percentages proficient above the median, and half have percentages profi- 
cient below it.) The results are shown in table 26. In grade 8 reading/language 
arts, for example, the median percentage proficient was 57% for low-income 
students and 8 1 % for students who were not low-income, a difference of 24 
percentage points. 

As table 26 also reveals, the range among states in percentages proficient was 
much greater for low-income students than for students who were not low- 
income. In high school reading/language arts, for example, the percentage pro- 
ficient for low-income students ranged from 96% in the highest state to 23% in 
the lowest state, compared with a high of 99% and a low of 46% for students 
who were not low-income. 



Table 26. Median, highest, and lowest percentages of LOW-INCOME 
and NON-LOW-INCOME students scoring proficient across 
all states with sufficient state test data, 2009 





READING 


MATHEMATICS 




Low-Income 


Not 

Low-Income 


Low-Income 


Not 

Low-Income 


Grade 4 


Median PP across states 


64% 


85% 


64% 


85% 


Highest PP in any state 


92% 


98% 


93% 


98% 


Lowest PP in any state 


29% 


60% 


28% 


58% 


# of states with data 


46 


46 


46 


46 


Grade 8 


Median PP across states 


57% 


81% 


51% 


76% 


Highest PP in any state 


92% 


97% 


86% 


95% 


Lowest PP in any state 


33% 


56% 


25% 


46% 


# of states with data 


46 


46 


46 


46 


High school 


Median PP across states 


60% 


82% 


43% 


67% 


Highest PP in any state 


96% 


99% 


84% 


94% 


Lowest PP in any state 


23% 


46% 


12% 


34% 


# of states with data 


43 


43 


42 


42 



Table reads: Across all 46 states with sufficient data, the median percentage of low-income students 
scoring proficient in grade 4 reading was 64%, compared with 85% for students who were not from 
low-income families. The highest percentage proficient for grade 4 reading in any state for the low- 
income subgroup was 92%, while the lowest in any state was 29%. 

PP = Percentage proficient 

NOTE: Forty-six states had sufficient 2009 data for both the low-income and non-low-income 
subgroups for one or more grade/subject combinations: AK, AL, AR, CA, CO, CT, DC, DE, FL, HI, IA, ID, 
IL, IN, KS, KY, LA, MA, MD, ME, MN, MO, MS, MT, NC, ND, NE, NH, NJ, NM, NV, NY, OH, OK, OR, PA, Rl, 
SC, TN, TX, UT, VA, VT, WA, Wl, and WY. States with fewer than 500 low-income test-takers in a 
particular grade/subject were excluded from the analysis for that grade/subject. States were also 
excluded if they did not provide data for the comparison group of students who were not low-income. 





The vast majority of states with sufficient data 
made gains on state tests for low-income students. 



Many more states showed gains since 2002 for low-income students than showed 
declines, according to both the percentages scoring proficient and average (mean) 
test scores. The most positive results were in grade 8; in both reading and math, 
93% or more of the states with sufficient data posted increases at this grade for the 
low-income subgroup, whether percentages proficient or mean scores were used. 

Trends in percentages proficient and mean scores were generally similar for low- 
income students. Across all subjects and grades, 93% of the trend lines analyzed 
showed gains using percentages proficient, and 90% showed gains using mean scores. 
In high school reading/language arts and math, however, a somewhat smaller share 
of states showed gains in mean scores than showed gains in percentages proficient. 



Table 27. Number (and percentage) of states with various trends for 
LOW-INCOME students on state tests, 2002-2009* 





READING 


MATHEMATICS 




Percentage 

proficient 


Mean score 


Percentage 

proficient 


Mean score 


Grade 4 


# and % of states with gain 


38 ( 90 %) 


31 ( 91 %) 


39 ( 91 %) 


31 ( 89 %) 


# and % of states with decline 


2 ( 5 %) 


2 ( 6 %) 


3 ( 7 %) 


3 ( 9 %) 


No change 


2 ( 5 %) 


1 ( 3 %) 


1 ( 2 %) 


1 ( 3 %) 


# of states with data 


42 


34 


43 


35 


Grade 8 


# and % of states with gain 


39 ( 93 %) 


33 ( 97 %) 


42 ( 98 %) 


33 ( 94 %) 


# and % of states with decline 


3 ( 7 %) 


0 


1 ( 2 %) 


1 ( 3 %) 


No change 


0 ( 0 %) 


1 ( 3 %) 


0 ( 0 %) 


1 ( 3 %) 


# of states with data 


42 


34 


43 


35 


High school 


# and % of states with gain 


35 ( 92 %) 


26 ( 84 %) 


36 ( 92 %) 


26 ( 84 %) 


# and % of states with decline 


3 ( 8 %) 


4 ( 13 %) 


3 ( 8 %) 


4 ( 13 %) 


No change 


0 ( 0 %) 


1 ( 3 %) 


0 ( 0 %) 


1 ( 3 %) 


# of states with data 


38 


31 


39 


31 


Table reads: On state grade 4 reading tests, 38 of the 42 states with sufficient data showed gains 
since 2002 in the percentage of low-income students scoring proficient, 2 showed declines, and 2 
showed no net change. Of the 34 states with sufficient mean score data, 31 showed gains for low- 
income students in average grade 4 reading scores, 2 showed declines, and 1 showed no net change. 

*The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 

NOTE: Forty-seven states had sufficient trend data for the low-income subgroup at one or more grade 
levels: AK, AL, AR, AZ, CA, CO, CT, DC, DE, FL, HI, IA, ID, IL, KS, KY, LA, MA, MD, ME, Ml, MN, MO, MT, NC, 
ND, NE, NH, NJ, NM, NV, NY, OH, OK, OR, PA, Rl, SC, SD, TN, TX, UT, VA, VT, WA, Wl, and WY. States with 
fewer than 500 low-income test-takers in a particular grade/subject or with fewer than three years of 
comparable test data were excluded from the analysis for that grade/subject. States were also 
excluded if they did not provide data for the comparison group of students who were not low-income. 
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Slow and Uneven Progress in Narrowing Gaps 



States have made mixed progress in narrowing 
gaps between low-income and more advantaged 
students. 



Since 2002, gaps between low-income and non-low-income students have nar- 
rowed in many states. But mean scores give a less positive picture of progress in 
narrowing these gaps than percentages proficient do. Across reading and math and 
three grade levels, just 57% of the low-income gaps in mean scores narrowed, 
compared with 72% of gaps in percentages proficient. In most cases where gaps 
narrowed, both low-income and non-low-income students made gains, but low- 
income students improved at a faster rate than their more advantaged peers. 

3^) At grade 4, a sizeable share of states made no progress in narrowing gaps in mean 

scores for low-income students. In both reading and math at this grade level, 
gaps widened or stayed the same more often than they narrowed. Gaps widened 
for various reasons. In grade 4 math, for example, gains by students who were 
not low-income outpaced gains by low- in come students in 1 0 of the 1 3 instances 
of widening mean score gaps. In 2 of the 1 3 instances, mean scores improved for 
non-low-income students but declined for low-income students. In one case, 
mean scores went up for non-low-income students but stayed the same for low- 
income students. 



Table 28. Number (and percentage) of states with various trends 
on state tests in the gap between LOW-INCOME and 
NON-LOW-INCOME students, 2002-2009* 





READING 


MATHEMATICS 




Percentage 

proficient 


Mean score 


Percentage 

proficient 


Mean score 


Grade 4 


# and % of states narrowed 


28 ( 74 %) 


14 ( 44 %) 


30 ( 79 %) 


14 ( 42 %) 


# and % of states widened 


9 ( 24 %) 


12 ( 38 %) 


7 ( 18 %) 


13 ( 39 %) 


No change 


1 ( 3 %) 


6 ( 19 %) 


1 ( 3 %) 


6 ( 18 %) 


# of states with data 


38 


32 


38 


33 


Grade 8 


# and % of states narrowed 


25 ( 66 %) 


23 ( 72 %) 


28 ( 74 %) 


21 ( 64 %) 


# and % of states widened 


10 ( 26 %) 


6 ( 19 %) 


9 ( 24 %) 


9 ( 27 %) 


No change 


3 ( 8 %) 


3 ( 9 %) 


1 ( 3 %) 


3 ( 9 %) 


# of states with data 


38 


32 


38 


33 


High school 


# and % of states narrowed 


22 ( 65 %) 


19 ( 66 %) 


26 ( 76 %) 


16 ( 55 %) 


# and % of states widened 


6 ( 18 %) 


5 ( 17 %) 


5 ( 15 %) 


10 ( 34 %) 


No change 


6 ( 18 %) 


5 ( 17 %) 


3 ( 9 %) 


3 ( 10 %) 


# of states with data 


34 


29 


34 


29 


Table reads: The gap between low-income and non-low income students in percentages scoring 
proficient on state grade 4 reading tests narrowed in 28 of the 38 states with sufficient data, widened 
in 9 states, and showed no net change in 1 state. The gap between these two groups in mean scores 
on grade 4 readingtests narrowed in 14 of the 32 states with sufficient data, widened in 12 states, 
and showed no net change in 6 states. 

*The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 

NOTE: Forty-one states had sufficient trend data for both the low-income and non-low-income subgroups 
at one or more grade levels: AK, AL, AR, CA, CO, CT, DC, DE, FL, HI, IA, IL, KS, KY, LA, MA, MD, ME, MN, 

MO, MT, NC, ND, NH, NJ, NM, NV, NY, OH, OK, OR, PA, Rl, SC, TN, TX, UT, VA, WA, Wl, and WY. States with 
fewer than 500 low-income test-takers in a particular grade/subject or with fewer than three years of 
comparable test data were excluded from the analysis for that grade/subject. States were also excluded 
if they did not provide data for the comparison group of students who were not low-income. 





Chapter 8: Male and Female Students 



On state reading tests, girls consistently 
outperform boys in every state. On math tests, 
girls and boys tend to perform at similar levels. 

In every state and D.C., higher percentages of girls than boys scored at or above 
the proficient level in reading in 2009. 4 In fact, this reading gap between boys 
and girls exceeded 10 percentage points (in favor of girls) in 6 states at grade 4, 
14 states at grade 8, and 8 states at the high school level. 

In math, the 2009 percentages proficient were fairly similar for boys and girls in 
most states. At grades 4 and 8, girls slightly outperformed boys in math in a 
majority of states; however, these differences rarely exceeded 6 percentage points. 
At the high school level, the math performance of the two genders was roughly 
equal. The appendix shows the percentages proficient for boys and girls in read- 
ing and math in individual states in 2009. 

One way to gauge the relative performance of boys and girls on a broader scale 
than a single state is to look at the median percentage proficient for 2009 across 
all of the states with sufficient data for both groups. (The median is the mid- 
point; by definition, half of the states with such data have percentages proficient 
above the median, and half have percentages proficient below it.) 

As shown in table 29, the median percentages proficient in reading were higher 
for girls than for boys at all three grade levels. At grade 8, for example, these 
medians were 77% for girls and 66% for boys. In math, the medians for the 
two genders were quite similar — a difference of just 1 or 2 percentage points in 
favor of girls — at all three grade levels. 



Table 29. Median, highest, and lowest percentages proficient for 

MALE and FEMALE students across all states with sufficient 
state test data, 2009 





READING 


MATHEMATICS 




Male 


Female 


Male 


Female 


Grade 4 


Median PP across states 


71% 


77% 


74% 


75% 


Highest PP in any state 


94% 


96% 


96% 


96% 


Lowest PP in any state 


39% 


51% 


41% 


43% 


# of states with data 


51 


51 


51 


51 


Grade 8 


Median PP across states 


66% 


77% 


66% 


67% 


Highest PP in any state 


94% 


97% 


91% 


93% 


Lowest PP in any state 


38% 


52% 


36% 


42% 


# of states with data 


51 


51 


51 


51 


High school 


Median PP across states 


71% 


79% 


61% 


63% 


Highest PP in any state 


97% 


98% 


93% 


94% 


Lowest PP in any state 


34% 


38% 


30% 


25% 


# of states with data 


48 


48 


48 


48 


Table reads: Across all 50 states and D.C., the median percentage of students scoring at or above the 
proficient level in grade 4 reading was 71% for boys and 77% for girls. The highest percentage 
proficient for grade 4 reading in any state for boys was 94%, while the lowest in any state was 39%. 


PP = Percentage proficient 










NOTE: All 50 states and the District of Columbia had sufficient 2009 data for both boys and girls for 
one or more grade/subject combinations. Three states (IN, NC, and NY) did not have 2009 data for 


boys and girls at the high school level. 










4 An exception to this pattern occurred at one grade level in Maine, where boys outperformed girls in read- 
ing/language arts at the high school level. 
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Slow and Uneven Progress in Narrowing Gaps 




Since 2002, scores on state reading 
and math tests have gone up for 
both boys and girls in the vast 
majority of states. 

Between 2002 and 2009, both males and females made 
gains reading and math in most states — from 73% to 98% 
of the states, depending on the grade level and subject. The 
numbers of states with gains were quite similar for boys and 
girls. And achievement gains outnumbered declines for boys 
and girls according to both percentages scoring proficient 
and average test scores. 

For both genders and both subjects, declines in achieve- 
ment were more prevalent at the high school level than at 
the other two grades. 



Table 30. Number (and percentage) of states with various trends for MALE and FEMALE 
students on state reading and mathematics tests, 2002-2009* 





MALE 


FEMALE 




Percentage proficient 


Mean score 


Percentage proficient 


Mean score 


Reading, grade 4 


# and % of states with gain 


36 (84%) 


29(81%) 


36 (84%) 


32 (89%) 


# and % of states with decline 


2 (5%) 


5(14%) 


5(12%) 


3 (8%) 


No change 


4 (9%) 


2 (6%) 


2 (5%) 


1 (3%) 


# of states with data 


43 


36 


43 


36 


Reading, grade 8 


# and % of states with gain 


40 (93%) 


32 (89%) 


40 (93%) 


32 (89%) 


#and % of states with decline 


3 (7%) 


2 (6%) 


3 (7%) 


3 (8%) 


No change 


0 (0%) 


2 (6%) 


0 (0%) 


1 (3%) 


# of states with data 


43 


36 


43 


36 


Reading, high school 


# and % of states with gain 


32 (84%) 


25(81%) 


31 (82%) 


23 (74%) 


#and % of states with decline 


6(16%) 


3(10%) 


7(18%) 


5(16%) 


No change 


0 (0%) 


3(10%) 


0 (0%) 


3(10%) 


# of states with data 


38 


31 


38 


31 


Math, grade 4 


# and % of states with gain 


40 (93%) 


33 (92%) 


42 (98%) 


33 (92%) 


# and % of states with decline 


3 (7%) 


2 (6%) 


0 (0%) 


2 (6%) 


No change 


0 (0%) 


1 (3%) 


1 (2%) 


1 (3%) 


# of states with data 


43 


36 


43 


36 


Math, grade 8 


# and % of states with gain 


42 (98%) 


35(97%) 


42 (98%) 


35(97%) 


# and % of states with decline 


1 (2%) 


1 (3%) 


1 (2%) 


1 (3%) 


No change 


0 (0%) 


0 (0%) 


0 (0%) 


0 (0%) 


# of states with data 


43 


36 


43 


36 


Math, high school 


# and % of states with gain 


32 (80%) 


24 (73%) 


32 (80%) 


24 (73%) 


#and % of states with decline 


7(18%) 


5(15%) 


8 (20%) 


6(18%) 


No change 


1 (3%) 


4(12%) 


0 (0%) 


3 (9%) 


# of states with data 


40 


33 


40 


33 


Table reads: On state grade 4 reading tests, 36 of the 43 states with sufficient data showed gains since 2002 in the percentage of 
male students scoring proficient, 2 showed declines, and 4 showed no net change. Of the 36 states with sufficient mean score data, 
29 showed gains for male students in average grade 4 reading scores, 5 showed declines, and 2 had no net change. 


*The years covered by these trends vary among states. Trends in some states begin later than 2002, although every state 


included in the table has at least three years of comparable test data ending in 2009. 




NOTE: Forty-eight states had sufficient trend data for both female and male students at one or more grade levels: AK, AL, AR, AZ, 
CA, CO, CT, DC, DE, FL, GA, HI, IA, ID, IL, KS, KY, LA, MA, MD, ME, Ml, MN, MO, MT, NC, ND, NE, NH, NJ, NM, NV, NY, OH, OK, OR, PA, 
Rl, SC, SD, TN,TX, UT, VA, VT, WA, Wl, and WY. States with fewer than three years of comparable test data were excluded from the 


analysis for that grade/subject. 













Progress in narrowing the boy-girl gap in reading 
has been uneven. 



Across all three grade levels, the male-female gap in reading has narrowed since 
2002 according to 62% of the trend lines analyzed using percentages proficient and 
58% of the trend lines analyzed using average (mean) scores. Progress varied by 
grade level and by whether percentages proficient or mean scores were used. And, 
as discussed in more detail in chapter 1 , the boy-girl gap in reading has narrowed 
at a slower rate than gaps for other subgroups. 

In reading at grades 4 and 8, gaps in percentages proficient between boys and 
girls have shrunk since 2002 in more than half the states with sufficient data, but 
have widened or stayed the same in a notable share of states. This uneven progress 
is especially evident using mean scores. At grade 4, the boy-girl gap in mean scores 
widened or stayed the same in over half the states with sufficient data. 

At the high school level, the male-female gap in reading narrowed in about three- 
fourths of the states with adequate data according to both percentages proficient 
and mean scores. 

In most cases where gaps narrowed, both groups improved, but boys improved 
more rapidly than girls. When gaps widened, both groups often improved, but 
girls made greater gains than boys. In grade 8 reading, for example, gains by girls 
outpaced gains by boys in 10 of 12 instances of widening mean score gaps. In 
one instance, scores went up for girls but stayed the same for boys; in the other 
instance, scores decreased for both groups, but decreased more for boys. 



Table 31. Number (and percentage) of states with various trends in 
the MALE-FEMALE achievement gap on state reading tests, 
2002-2009* 





READING 




Percentage proficient 


Mean score 


Grade 4 


# and % of states narrowed 


23 (53%) 


15(42%) 


# and % of states widened 


15(35%) 


10(28%) 


No change 


5(12%) 


11 (31%) 


# of states with data 


43 


36 


Grade 8 


# and % of states narrowed 


26 (60%) 


21 (58%) 


# and % of states widened 


14(33%) 


12(33%) 


No change 


3 (7%) 


3 (8%) 


# of states with data 


43 


36 


High school 


# and % of states narrowed 


28 (74%) 


23 (74%) 


# and % of states widened 


2 (5%) 


5(16%) 


No change 


8(21%) 


2 (6%) 


# of states with data 


38 


30 


Table reads: The gap between male and female students in percentages scoring proficient on state 
grade 4 reading tests narrowed in 23 of the 43 states with sufficient data, widened in 15 states, and 
showed no net change in 5 states. The male-female gap in mean scores on grade 4 reading tests 
narrowed in 15 of the 36 states with sufficient data, widened in 10 states, and showed no net 


change in 11 states. 






*The years covered by these trends vary among states. Trends in some states begin later than 2002, 
although every state included in the table has at least three years of comparable test data ending in 2009. 


NOTE: Forty-eight states had sufficient trend data for both female and male students at one or more 
grade levels: AK, AL, AR, AZ, CA, CO, CT, DC, DE, FL, GA, HI, IA, ID, IL, KS, KY, LA, MA, MD, ME, Ml, MN, 
MO, MT, NC, ND, NE, NH, NJ, NM, NV, NY, OH, OK, OR, PA, Rl, SC, SD, TN, TX, UT, VA, VT, WA, Wl, and 
WY. States with fewer than three years of comparable test data were excluded from the analysis for 


that grade/subject. 
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Chapter 9: Comparison of Trends on State Tests and NAEP 




Background on state tests and NAEP 

As another indicator of whether achievement has improved and gaps have nar- 
rowed for subgroups, we looked at whether state-level trends for student groups 
on the main National Assessment of Educational Progress have moved in the 
same direction as trends on state tests. The goal was to see whether NAEP trends 
confirm or contradict the patterns found on state tests. When trends on both 
types of assessments agree within the same state, this provides more evidence 
that achievement is improving or declining. 

The methods used to compare trends on state tests and NAEP are discussed more 
fully in chapter 10. In general, we analyzed trends from 2005 through 2009 at 
grades 4 and 8 in the states with sufficient data on both state tests and NAEP 5 On 
both types of assessments, we looked at the direction of changes using two per- 
formance indicators. First, we examined trends in mean, or average, test scores, 
which are a useful indicator of changes in achievement gaps because they are not tied 
to a specific cut score for proficient or basic performance. Second, we analyzed 
trends in the percentages of students reaching the proficient level of achievement on 
state tests and the basic level on NAEP (Chapter 1 0 explains why the basic level on 
NAEP is closest to the proficient level on most state tests.) For reasons described in 
chapter 10, we included gains or declines of any size on either NAEP or state tests. 

A total of 25 states had sufficient data for at least some of the NAEP and state 
test analyses, but this number varied by grade level and subgroup. 6 In grade 8 
math, for example, 21 states had sufficient percentage proficient/basic data for 
the white subgroup, while 9 states had sufficient data for the Asian subgroup. 

It is important to understand how NAEP differs from state tests and why these 
differences may sometimes lead to different results on the two assessments: 



• NAEP is administered every two years to representative samples of students 
in a sample of schools in each state, rather than annually to virtually all stu- 
dents in a state, as state tests are. Each NAEP participant takes only a por- 
tion of the larger assessment instead of the entire test, so NAEP cannot 
produce scores for individual students or schools. 

• NAEP differs, to varying degrees, from state tests in the content assessed, 
test question formats, rigor of the achievement levels, testing environment 
and administration, and other features. For example, state tests are designed 
to measure how well students have learned the knowledge and skills embod- 
ied in that particular state’s academic content standards, while NAEP con- 
tent is deliberately not aligned to any state’s standards. 

• The NAEP definition of “proficient” performance is more ambitious than 
many state definitions. For NAEP, “proficient” represents an aspirational goal 
for what students should know and be able to do, while on most state tests, 
“proficient” describes a level of performance that is good enough to be 
regarded as acceptable for a particular grade level. This is one reason why 
this study compares state proficient results with NAEP basic results. 

• NAEP is considered a “low-stakes” test. Unlike the results of “high-stakes” 
state tests, NAEP scores are not tied to specific consequences for individual 
students, teachers, schools, or districts. 

The tables in this chapter compare trends on state tests and NAEP within the same 
state. Trends moved upward so often on both assessments that there was a fair 
amount of agreement between state tests and NAEP simply by virtue of chance. 
Because we were also interested in the extent to which both state tests and NAEP 
have picked up on the same student achievement trends, whether upward or down- 
ward, we also calculated whether the levels of agreement between the two types of 
assessments exceeded what would be expected by chance. These instances are 
marked with asterisks in the tables in this chapter. 7 



5 High school trends were not included because NAEP only recently began reporting state-level data for grade 12 in a limted pilot so trends cannot be determined. In addition, NAEP is administered in grade 12, while most state 
high school tests are administered in grades 10 or 11. 

6 These states include AL, AK, AZ, AR, CA, CO, DE, FL, IA, LA, MA, MD, MT, ND, NE, NM, NV, OH, OR, PA, TN, TX, UT, WA, and Wl. 

7 Our thanks to Dr. Andrew Ho, Harvard Graduate School of Education, for noting the “chance” issue. 



In reading, gains for subgroups on 
NAEP confirmed gains on state tests to 
a moderate extent. However, trends on 
NAEP and state tests contradicted each 
other or declined more often in 
reading than in math. 

For nearly all of the subgroups analyzed, a majority of the states 
with sufficient data showed gains in reading between 2005 and 
2009 on both state tests and NAEP This pattern was evident 
in both mean scores (table 32) and percentages proficient/ 
basic (table 33) for all subgroups except boys. Several states, 
however, had declines for some subgroups on one or both 
assessments. 

Reading trends varied by grade level and subgroup. At grade 4, 
African American, Asian, low-income, and female students 
generally made progress on both NAEP and state tests, but 
trends for Latino students, white students, and boys sometimes 
moved in contradictory directions on the two assessments. At 
grade 8, NAEP and state tests showed contradictory trends in 
a notable number of states for several subgroups. 

Trends in reading for boys and girls differed markedly at grade 
4. Girls made gains on both state tests and NAEP in a major- 
ity of the states with sufficient data, while boys more often had 
declines or contradictory trends on the two assessments. 



Table 32. READING, MEAN SCORES: Number of states in which subgroup trends 
moved in the same or a different direction on state tests and NAEP, 
2005-2009 





African 

American 


Asian 


Latino 


White 


Low- 

Income 


Male 


Female 


Grade 4 reading 


# of states with data 


11 


8 


11 


14 


11 


13 


13 


Same direction 


10 


8 


7 


9 


9 


6 


12 


Both up 


8 


6 


6 


8 


8 


5 


10 


Both down 


2 


2 


1 


1 


1 


1 


2 


Different direction 


1 


0 


4 


4 


1 


5 


1 


State test up, NAEP down 


0 


0 


3 


3 


1 


4 


0 


NAEP up, state test down 


1 


0 


1 


1 


0 


1 


1 


One flat 


0 


0 


0 


1 


1 


2 


0 


% of states same direction 


91%* 


100%* 


64%* 


64%* 


82%* 


46%* 


92%* 


% of states both up 


73%* 


75%* 


55%* 


57%* 


73%* 


38%* 


77%* 


Grade 8 reading 


# of states with data 


12 


8 


13 


17 


16 


16 


16 


Same direction 


8 


5 


11 


12 


11 


11 


11 


Both up 


8 


5 


11 


12 


11 


11 


10 


Both down 


0 


0 


0 


0 


0 


0 


1 


Different direction 


4 


1 


2 


5 


4 


4 


5 


State test up, NAEP down 


3 


1 


2 


4 


4 


3 


3 


NAEP up, state test down 


1 


0 


0 


1 


0 


1 


2 


One flat 


0 


2 


0 


0 


1 


1 


0 


% of states same direction 


67% 


63% 


85% 


71% 


69% 


69%* 


69%* 


% of states both up 


67% 


63% 


85% 


71% 


69% 


69%* 


63%* 


Table reads: In 10 of the 11 states with sufficient data, trends in mean test scores for African American students in grade 4 
reading moved in the same direction— upward in 8 cases— on both state tests and NAEP. Two states had a decline for African 
American 4 th graders on both types of reading assessments. In one state, mean scores for this subgroup increased on one 
assessment but decreased on the other. 


‘This level of agreement is greater than what would have been expected by chance. 
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Table 33. READING, PERCENTAGES PROFICIENT/BASIC: Number of states in which 
subgroup trends moved in the same or a different direction on state tests 
and NAEP, 2005-2009 





African 

American 


Asian 


Latino 


White 


Low- 

Income 


Male 


Female 


Grade 4 reading 


# of states with data 


17 


12 


17 


21 


20 


21 


21 


Same direction 


14 


10 


10 


17 


18 


14 


18 


Both up 


13 


9 


9 


16 


16 


13 


17 


Both down 


1 


1 


1 


1 


2 


1 


1 


Different direction 


1 


2 


5 


3 


1 


2 


2 


State test up, NAEP down 


0 


1 


3 


2 


1 


2 


1 


NAEP up, state test down 


1 


1 


2 


1 


0 


0 


1 


One flat 


2 


0 


2 


1 


1 


5 


1 


% of states same direction 


82%* 


83%* 


59%* 


81%* 


90%* 


67%* 


86%* 


% of states both up 


76%* 


7 5%* 


53%* 


76%* 


80%* 


62%* 


81%* 


Grade 8 reading 


# of states with data 


16 


10 


16 


21 


21 


21 


21 


Same direction 


12 


7 


13 


16 


18 


19 


15 


Both up 


12 


7 


13 


16 


18 


19 


15 


Both down 


0 


0 


0 


0 


0 


0 


0 


Different direction 


4 


1 


3 


4 


3 


1 


5 


State test up, NAEP down 


3 


1 


2 


2 


2 


0 


4 


NAEP up, state test down 


1 


0 


1 


2 


1 


1 


1 


One flat 


0 


2 


0 


1 


0 


1 


1 


% of states same direction 


75% 


70%* 


81% 


76% 


86% 


91% 


71%* 


% of states both up 


75% 


70%* 


81% 


76% 


86% 


91% 


71%* 


Table reads: In 14 of the 17 states with sufficient data, trends in the percentage of African American students scoring 
proficient on state grade 4 reading tests moved in the same direction as trends in the percentage scoring basic on NAEP. In 
13 of these 14 states, trends on both assessments moved upward. One state showed a decline for African Americans 4 th 
graders on both types of assessments. And in one state, the percentage of African American students scoring proficient on 
the state grade 4 reading test went down while the percentage scoring basic on NAEP went up. 

‘This level of agreement is greater than what would have been expected by chance. 






In math, NAEP results confirmed state 
test results more often than in reading. 
In most of the states studied, all 
subgroups except Asian students 
made gains in math on both state tests 
and NAEP, especially at grade 8. 

In a majority of the states with sufficient data, nearly all sub- 
groups made gains in math on both state tests and NAEP 
between 2005 and 2009. This pattern was apparent in mean 
scores (table 34) , as well as in percentages proficient/basic 
(table 35), for low-income students, girls and boys, and all 
major racial/ethnic groups except Asian students. 

Within the same state, gains on NAEP often confirmed gains 
for subgroups on state tests. In grade 8 math, trends were espe- 
cially positive on both assessments in a high percentage of the 
states analyzed. African American students in particular appear 
to have made solid progress in grade 8 math — both NAEP 
and state tests showed gains in grade 8 math in all 14 states 
with mean score data and all 1 8 states with percentage profi- 
cient/basic data. 

In a limited number of instances, NAEP results in math con- 
tradicted state test results. This was particularly true for Latino 
and male students at grade 4. In most of these cases, the NAEP 
trend showed a gain while the state test trend showed a decline. 
In one state, math scores declined on both assessments for 
African Americans at grade 4. 

Fewer states made progress in raising the percentages scoring 
proficient/basic in math for Asian students than for other sub- 
groups. This may be because the Asian subgroup is the high- 
est performing, and a large percentage of these students — more 
than 90% in grade 4 math — have already surpassed the profi- 
cient/basic level. 



Table 34. MATH, MEAN SCORES: Number of states in which subgroup trends moved 
in the same or a different direction on state tests and NAEP, 2005-2009 





African 

American 


Asian 


Latino 


White 


Low- 

Income 


Male 


Female 


Grade 4 math 


# of states with data 


11 


7 


10 


13 


11 


12 


12 


Same direction 


9 


5 


6 


9 


8 


8 


9 


Both up 


8 


5 


6 


9 


8 


8 


9 


Both down 


1 


0 


0 


0 


0 


0 


0 


Different direction 


2 


2 


3 


2 


2 


3 


2 


State test up, NAEP down 


2 


1 


2 


1 


2 


3 


1 


NAEP up, state test down 


0 


1 


1 


1 


0 


0 


1 


One flat 


0 


0 


1 


2 


1 


1 


1 


% of states same direction 


82%* 


71% 


60% 


69% 


73% 


67%* 


75% 


% of states both up 


73%* 


71% 


60% 


69% 


73% 


67%* 


75% 


Grade 8 math 


# of states with data 


14 


9 


12 


16 


15 


15 


15 


Same direction 


14 


7 


11 


15 


13 


14 


13 


Both up 


14 


1 


11 


15 


13 


14 


13 


Both down 


0 


0 


0 


0 


0 


0 


0 


Different direction 


0 


1 


1 


1 


2 


1 


2 


State test up, NAEP down 


0 


1 


1 


0 


1 


0 


1 


NAEP up, state test down 


0 


0 


0 


1 


1 


1 


1 


One flat 


0 


1 


0 


0 


0 


0 


0 


% of states same direction 


100% 


78% 


92% 


94% 


87% 


93% 


87% 


% of states both up 


100% 


78% 


92% 


94% 


87% 


93% 


87% 


Table reads: In 9 of the 11 states with sufficient data, trends in mean test scores for African American students in grade 4 
math moved in the same direction on both state tests and NAEP. In 8 of these 9 states, trends for African Americans moved 
upward on both assessments; in the remaining state, trends declined on both. In two states, mean scores for African 
American students moved upward on the state test but downward on NAEP. 

*This level of agreement is greater than what would have been expected by chance. 
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Table 35. MATH, PERCENTAGES PROFICIENT/BASIC: Number of states in which 

subgroup trends moved in the same or a different direction on state tests 
and NAEP, 2005-2009 





African 

American 


Asian 


Latino 


White 


Low- 

Income 


Male 


Female 


Grade 4 math 


# of states with data 


16 


11 


15 


19 


13 


19 


19 


Same direction 


14 


3 


11 


13 


11 


11 


15 


Both up 


13 


3 


11 


13 


11 


10 


15 


Both down 


1 


0 


0 


0 


0 


1 


0 


Different direction 


2 


5 


3 


2 


2 


3 


2 


State test up, NAEP down 


2 


3 


2 


2 


2 


3 


1 


NAEP up, state test down 


0 


2 


1 


0 


0 


0 


1 


One flat 


0 


3 


1 


4 


0 


5 


2 


% of states same direction 


88%* 


27% 


73% 


68%* 


85% 


58%* 


79% 


% of states both up 


81%* 


27% 


73% 


68%* 


85% 


53% 


79% 


Grade 8 math 


# of states with data 


18 


9 


16 


21 


7 


21 


21 


Same direction 


18 


5 


14 


19 


7 


20 


18 


Both up 


18 


5 


14 


19 


7 


20 


18 


Both down 


0 


0 


0 


0 


0 


0 


0 


Different direction 


0 


2 


1 


1 


0 


1 


1 


State test up, NAEP down 


0 


2 


1 


0 


0 


0 


0 


NAEP up, state test down 


0 


0 


0 


1 


0 


1 


1 


One flat 


0 


2 


1 


1 


0 


0 


2 


% of states same direction 


100% 


56% 


88% 


91% 


100% 


95%* 


86% 


% of states both up 


100% 


56% 


88% 


91% 


100% 


95%* 


86% 


Table reads: In 14 of the 16 states with sufficient data, trends in the percentage of African American students scoring 
proficient on state grade 4 math tests moved in the same direction as trends in the percentage scoring basic on NAEP. 

In 13 of these 14 states, trends for African Americans moved upward on both assessments; in the remaining state, trends 
declined on both. In two states, the percentage of African American students scoring proficient on state grade 4 math tests 
went up while the percentage scoring basic on NAEP went down. 

‘This level of agreement is greater than what would have been expected by chance. 






State tests and NAEP show little agreement about 
whether achievement gaps have narrowed in 
reading since 2005. 



Progress has been mixed in narrowing achievement gaps in reading from 2005 
to 2009, according to evidence from states with sufficient data on both state 
tests and NAEP Within the same state, NAEP results often contradicted state 
test results. In several instances, a gap narrowed on the state test but widened on 
NAEP, or vice versa. And in some instances, gaps widened on both assessments. 

For most subgroups, progress in narrowing gaps appeared somewhat less posi- 
tive using mean scores (table 36) than percentages proficient/basic (table 37). 

States made lackluster progress in narrowing the gap in reading between boys and 
girls. According to mean scores, this gap narrowed on both state tests and NAEP 
in just 2 of the 13 states with sufficient data at grade 4, and in just 2 of 16 states 
at grade 8. The results were particularly disappointing according to percentages 
proficient/basic at grade 4. 

The gaps in reading between African American and white students, and between 
Latino and white students, widened on NAEP, on the state test, or on both in a 
notable number of states. 



Table 36. READING, MEAN SCORES: Number of states in which gap 
trends moved in the same or a different direction on state 
tests and NAEP, 2005-2009 





African 

American/ White 


Latino/ 

White 


Low-Income/ 
Not Low-Income 


Male/ 

Female 


Grade 4 


# of states with data 


11 


11 


11 


13 


Same direction 


4 


5 


5 


6 


Narrowed on both 


3 


4 


4 


2 


Widened on both 


1 


1 


1 


4 


Different direction 


4 


4 


3 


7 


Narrowed on state test, 
widened on NAEP 


0 


3 


0 


5 


Narrowed on NAEP, 
widened on state test 


4 


1 


3 


2 


One flat 


3 


2 


3 


0 


% of states same direction 


36%* 


46%* 


46%* 


46% 


% of states both narrowed 


2 7%* 


36%* 


36%* 


15% 


Grade 8 


# of states with data 


12 


13 


16 


16 


Same direction 


7 


8 


9 


5 


Narrowed on both 


4 


5 


5 


2 


Widened on both 


3 


3 


4 


3 


Different direction 


5 


3 


7 


9 


Narrowed on state test, 
widened on NAEP 


3 


3 


6 


7 


Narrowed on NAEP, 
widened on state test 


2 


0 


1 


2 


One flat 


0 


2 


0 


2 


% of states same direction 


58%* 


62%* 


56%* 


31% 


% of states both narrowed 


33%* 


38%* 


31%* 


13% 


Table reads: In 3 of the 11 states with sufficient data, the gap in mean scores between African 
American and white students in grade 4 reading narrowed on both state tests and NAEP. In one state 
this gap widened on both assessments. In 4 states, the African American-white gap in grade 4 
reading widened on one assessment and narrowed on the other. 

*This level of agreement is greater than what would have been expected by chance. 
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Table 37. READING, PERCENTAGES PROFICIENT/BASIC: Number of 

states in which gap trends moved in the same or a different 
direction on state tests and NAEP, 2005-2009 





African 

American/ White 


Latino/ 

White 


Low-Income/ 
Not Low-Income 


Male/ 

Female 


Grade 4 


# of states with data 


17 


17 


16 


21 


Same direction 


13 


10 


11 


4 


Narrowed on both 


11 


8 


8 


1 


Widened on both 


2 


2 


3 


3 


Different direction 


2 


7 


3 


10 


Narrowed on state test, 
widened on NAEP 


1 


5 


3 


9 


Narrowed on NAEP, 
widened on state test 


1 


2 


0 


1 


One flat 


2 


0 


2 


7 


% of states same direction 


77%* 


59%* 


69%* 


19% 


% of states both narrowed 


65%* 


47%* 


50%* 


5% 


Grade 8 


# of states with data 


16 


16 


21 


21 


Same direction 


11 


8 


11 


9 


Narrowed on both 


9 


7 


10 


8 


Widened on both 


2 


1 


1 


1 


Different direction 


3 


5 


8 


7 


Narrowed on state test, 
widened on NAEP 


3 


5 


6 


2 


Narrowed on NAEP, 
widened on state test 


0 


0 


2 


5 


One flat 


2 


3 


2 


5 


% of states same direction 


69%* 


50%* 


52% 


43% 


% of states both narrowed 


56%* 


50%* 


48% 


38% 


Table reads: In 13 of the 17 states with sufficient data in grade 4 reading, the gap between African American 
and white students in the percentage reaching the proficient level on the state test moved in the same 
direction as the gap in the percentage reaching the basic level on NAEP. In 11 of these 13 states, the African 
American-white gap narrowed on both assessments, while in 2 states it widened on both. In two states, the 
African American-white gap in grade 4 reading widened on one assessment and narrowed on the other. 


*This level of agreement is greater than what would have been expected by chance. 








State tests and NAEP show little agreement about 
whether achievement gaps have narrowed in 
math since 2005. 

Within the same state, gaps between subgroups in math often narrowed on state 
assessments and widened on NAEP, or vice versa. For the Latino-white gap, 
trends on state tests and NAEP moved in contradictory directions more often 
than they agreed. 

Instances of gaps narrowing on both indicators were less positive using mean 
scores (table 38) than they were using percentages proficient/basic (table 39). 
According to mean scores, gaps in grade 4 math narrowed on both assessments 
in about one-fourth or less of the states with sufficient data. 

Although African American students showed improvement in grade 8 math on 
both state tests and NAEP in every state with sufficient data, this has not trans- 
lated into progress in narrowing gaps in every state. According to mean scores, 
the African American-white gap in grade 8 math narrowed on both NAEP and 
state tests in 9 of 14 states but showed mixed results on the two assessments in 
the other 5 states. 



Table 38. MATHEMATICS, MEAN SCORES: Number of states in which 
gap trends moved in the same or a different direction on 
state tests and NAEP, 2005-2009 





African American/ 
White 


Latino/ White 


Low-Income/ 
Not Low-Income 


Grade 4 


# of states with data 


11 


10 


11 


Same direction 


6 


2 


6 


Narrowed on both 


3 


2 


2 


Widened on both 


3 


0 


4 


Different direction 


4 


6 


5 


Narrowed on state test, 
widened on NAEP 


2 


3 


3 


Narrowed on NAEP, 
widened on state test 


2 


3 


2 


One flat 


1 


2 


0 


% of states same direction 


55%* 


20% 


55%* 


% of states both narrowed 


2 7%* 


20% 


18%* 


Grade 8 


# of states with data 


U 


12 


15 


Same direction 


9 


7 


11 


Narrowed on both 


9 


6 


7 


Widened on both 


0 


1 


4 


Different direction 


4 


4 


3 


Narrowed on state test, 
widened on NAEP 


3 


4 


3 


Narrowed on NAEP, 
widened on state test 


1 


0 


0 


One flat 


1 


1 


1 


% of states same direction 


64% 


58%* 


73%* 


% of states both narrowed 


64% 


50%* 


47%* 


Table reads: In 6 of the 11 states with sufficient data, the gap in mean test scores between African 
American and white students in grade 4 math showed similar trends on both state tests and NAEP. In three 
states, this gap narrowed on both assessments, and in three states it widened on both. In four states, the 
African American-white gap in grade 4 math narrowed on one assessment and widened on the other. 

*This level of agreement is greater than what would have been expected by chance. 
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Table 39. MATHEMATICS, PERCENTAGES PROFICIENT/BASIC: Number 
of states in which gap trends moved in the same or a 
different direction on state tests and NAEP, 2005-2009 





African American/ 
White 


Latino/ White 


Low-Income/ 
Not Low-Income 


Grade 4 


# of states with data 


16 


15 


13 


Same direction 


12 


10 


9 


Narrowed on both 


11 


10 


8 


Widened on both 


1 


0 


1 


Different direction 


2 


4 


1 


Narrowed on state test, 
widened on NAEP 


2 


4 


0 


Narrowed on NAEP, 
widened on state test 


0 


0 


1 


One flat 


2 


1 


3 


% of states same direction 


75%* 


67% 


69%* 


% of states both narrowed 


69%* 


67% 


62%* 


Grade 8 


# of states with data 


18 


16 


7 


Same direction 


15 


10 


3 


Narrowed on both 


15 


9 


2 


Widened on both 


0 


1 


1 


Different direction 


3 


4 


3 


Narrowed on state test, 
widened on NAEP 


0 


3 


0 


Narrowed on NAEP, 
widened on state test 


3 


1 


3 


One flat 


0 


2 


1 


% of states same direction 


83% 


63%* 


43%* 


% of states both narrowed 


83% 


56%* 


29% 


Table reads: In 12 of the 16 states with sufficient data in grade 4 math, the gap between African 
American and white students in the percentage reaching the proficient level on the state test moved in 
the same direction as the gap in the percentage reachingthe basic level on NAEP. In 11 of these 12 
states, this gap narrowed on both assessments, while in 1 state it widened on both. In two states, the 
African American-white gap in grade 4 math narrowed on one assessment and widened on the other. 

*This level of agreement is greater than what would have been expected by chance. 






Chapter 10: Study Methods 



CEP’S ACHIEVEMENT RESEARCH 

The Center on Education Policy has been studying student achievement since 
2007 with advice from a panel of five nationally known experts in educational 
testing or education policy. 8 To carry out this research, we have collected an 
extensive set of state test data from all 50 states (and this year from the District 
of Columbia) with considerable technical support from our contractor, the 
Human Resources Research Organization (HumRRO). State officials have ver- 
ified the accuracy of the data. 

UPDATES IN THIS YEAR’S REPORT 

This report, the second part of our 2010 series on test score trends, adds another 
year of data from state tests administered in 2008-09 and from the 2009 admin- 
istration of NAEE This creates longer trend lines in some states. The District of 
Columbia also participated in our data collection for the first time. In addition, 
the report looks more deeply than our previous reports did at trends in average 
(mean) scores on state tests and NAEP. 

SUBGROUPS INCLUDED 

Our analyses include trends for African American, Asian, Latino, Native 
American, and white students, as well as students from low-income families 
(compared with those who are not low- income), males, and females. Native 
Americans were not included in the state-NAEP comparisons because in many 
states the NAEP samples of Native American test-takers were too small, or 
because fewer than 500 Native American students took the state test at grade 
4 or 8. 

Trends for students with disabilities and English language learners, two other 
subgroups tracked for NCLB accountability, are not included in this report. 
CEP released special reports on these subgroups in 2009 and 2010 and con- 



cluded that it is difficult to obtain a clear picture of achievement for students 
with disabilities and English language learners because of fuzzy data, evolving 
state testing policies, fluctuating numbers of test-takers, and language barriers in 
the case ofELLs. 

YEARS COVERED 

The analyses of subgroup trends on state tests alone extend from 2002 (or a 
more recent year in some states) through 2009 and represent the most recent 
cycle of test results reported for NCLB by the time our data collection ended in 
June 2010. We used 2002 as the starting point because many states did not break 
out their test results by student subgroup and achievement level until they were 
required to do so by NCLB, and because trends in the limited number of states 
with comparable pre-2002 data were discussed in our 2007 report. 9 This year, 
as in past years, only trend lines that encompassed at least three years of com- 
parable test data for a particular subgroup, subject, grade, and achievement level 
were included in our analyses. States with at least three years of comparable data 
but fewer than the full eight years were included in the analysis of a particular 
grade and subject as long as their data extended through 2008-09. Test data 
were not considered comparable if, during the period of analysis, a state had (^45 
introduced new tests, changed its cut scores for proficient performance, or made 
other major changes in its testing program; these types of “breaks” in test data 
make year-to-year comparisons invalid. 

The comparisons of trends on NAEP and state tests covered the same span for 
both assessments, 2005 through 2009. We focused on 2005 through 2009 
because a shorter trend lines (2007-2009) would have been more subject to 
short-term fluctuations and therefore less reliable, and a longer trend line 
(2003-2009) would have excluded many more states. A maximum of 25 states, 
listed in chapter 9, had comparable state test data for 2005 and 2009 and could 
be included in at least some of the analyses. All states had NAEP data for these 



8 Members of the expert panel include Laura Hamilton, senior behavioral scientist, RAND Corporation; Eric Hanushek, senior fellow, Hoover Institution; Frederick Hess, director of education policy studies, American Enterprise Institute; 
Robert L. Linn, professor emeritus, University of Colorado; and W. James Popham, professor emeritus, University of California, Los Angeles. 

9 Center on Education Policy. (2007). Answering the question that matters most: Has student achievement increased since No Child Left Behind? Washington, DC: Author. 
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years, but for most subgroups, the number of states with sufficient state and 
NAEP data was much smaller. 




STATES EXCLUDED 

States were excluded from the analysis of a particular grade, subject, and sub- 
group if they had fewer than three years of comparable data, or if data were 
unavailable or missing for other reasons. Fewer states provided mean test scores 
than provided percentages proficient. In addition, states were omitted from a 
grade/subject analysis if the number of test-takers in a particular subgroup was 
fewer than 500, as this was too small to allow for a reliable determination of 
trends. States were also excluded if they did not provide data for students who 
are not low-income, because a comparison could not be made with low-income 
students in order to analyze achievement gaps. For the NAEP analyses, states 
were excluded if the number of students in the NAEP sample for a particular 
subgroup did not meet the minimum size requirements for NAEP reporting. 



SUBJECTS AND GRADE LEVELS 

For the analyses that focused on state test results alone, we looked at trends in 
reading and mathematics, the subjects tested for NCLB accountability, at grades 
4, 8, and the high school grade tested for NCLB, usually grade 10 or 11. (Utah 
uses an end-of-course test of pre-algebra as its grade 8 test, which students take 
after they have completed the appropriate course.) 

For the NAEP-state comparisons, we examined reading and math trends at 
grades 4 and 8. NAEP data at the high school level were not reported by state 
in 2005 and 2009; moreover, NAEP is given in grade 12, whereas most state tests 
are administered in grade 10 or 1 1. 



USEOFTREND LINES 

State tests vary greatly in difficulty, content, scoring scales, cut scores for pro- 
ficiency, and other aspects. Within two different states, for example, the same 
percentage proficient may signify different degrees of achievement and learn- 
ing. Because of the diversity in state tests, we based our analyses on trend lines. 
A trend line is a record of change in the percentage proficient or mean score for 
a specific subgroup or a specific gap in one state, subject, and grade level 
between 2002 (or a more recent starting year in some states) and 2009. For 



example, the change from 2002 to 2009 in the percentage proficient in math 
for Asian 8 th graders in Colorado constitutes one trend line. We calculated the 
number and percentage of trend lines that showed a gain, decline, or no net 
change in performance for a particular subgroup, as well as the number and per- 
centage of trend lines that showed a narrowing, widening, or no net change in 
a particular achievement gap. 

We determined movement in trend lines by using average annual changes in test 
results. These were calculated by taking the overall increase or decrease in the 
percentage proficient/basic or mean score and dividing it by the number of 
years of testing minus one (because we are looking at the difference between two 
years). To determine whether achievement gaps narrowed or widened, we com- 
pared the average annual gain in the mean score or the percentage proficient 
made by a lower-performing subgroup, such as African American students, 
with the average annual gain of higher-performing group, such as white stu- 
dents, in the same state, subject, and grade level. If the average gain for the 
lower-performing subgroup was larger that of the higher-performing group, 
we counted this as one instance of an achievement gap narrowing; if the aver- 
age gain for the lower-performing group was smaller, we counted it as an 
instance of an achievement gap widening. 



MEAN SCORES 

As one indicator of achievement, this study analyzed mean scores. A mean score 
is the average of a group of test scores expressed on a common scoring scale for 
a particular state’s test. It is calculated by adding up all of the scores of the mem- 
bers of a group (such as all low-income students in Iowa who took the states 8 th 
grade reading test) and dividing the sum by the number of scores. States use dif- 
ferent numerical scoring scales, such as 1-100 in one state and 1-500 in another. 

In some respects, mean scores are a better measure of trends in achievement gaps 
than percentages proficient because they do not depend on where cut scores for 
proficiency are set. Mean scores also pick up changes along the entire scoring 
scale, not just at the proficient level. Therefore, mean scores avoid the problem, 
described in chapter 1 , of gaps appearing smaller or larger depending on where 
the cut score for proficiency is set. 



